00010000:00010000:1.0F:1788574397.908123:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1788574398.944825:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0F:1788574399.125038:0:17047:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934634 is committed 00000020:00080000:2.0:1788574399.125088:0:17047:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c84c357f480 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:2.0:1788574399.125094:0:17047:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c85fadcd200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c84c357f6c0 00000020:00080000:2.0:1788574399.125098:0:17047:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c85fadcda00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c85c5f8fc00 00010000:00010000:1.0:1788574399.125252:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d890 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788574399.125260:0:17105:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00010000:00010000:1.0:1788574399.125268:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d890 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574399.125277:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d890 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574399.125283:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217ea00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574399.125289:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d890 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574399.125297:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d890 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574399.125321:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c85d10a6100) 00010000:00010000:1.0:1788574399.125324:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574399.125330:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d890 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574399.125337:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d890 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788574399.125360:0:17105:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1788574399.128681:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681721088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574399.128791:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574399.131243:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681721088 00000100:00100000:2.0:1788574399.131266:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681721088 00000100:00100000:2.0:1788574399.131385:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788574399.131403:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681721088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788574399.131452:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788574399.131577:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681721088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 182us (2785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574399.131586:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788574399.131647:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0F:1788574399.131677:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681721088:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788574399.955768:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574400.094835:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574400.094882:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574400.094927:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574400.094965:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669059840 00000100:00100000:3.0:1788574400.094978:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669059840 00000100:00100000:3.0:1788574400.095037:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 170 00000100:00100000:3.0:1788574400.095048:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:2396:x1875455669059840:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574400.095134:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:2396:x1875455669059840:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 87us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574400.095143:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 170 00000100:00100000:3.0:1788574400.095224:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669060096 00000100:00100000:3.0:1788574400.095229:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669060096 00000100:00100000:3.0:1788574400.095273:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669059968 00000100:00100000:3.0:1788574400.095277:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669059968 00000100:00100000:3.0:1788574400.095308:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:3.0:1788574400.095315:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2396:x1875455669060096:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574400.095349:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2396:x1875455669060096:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 34us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574400.095356:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:3.0:1788574400.095371:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:3.0:1788574400.095377:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+12:2396:x1875455669059968:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574400.095732:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+12:2396:x1875455669059968:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 353us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574400.095741:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00080000:3.0:1788574400.095765:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574400.095777:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574400.108960:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574400.109083:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574400.109121:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574400.109149:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574400.109175:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574400.109756:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574400.110204:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669060224 00000100:00100000:2.0:1788574400.110234:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669060224 00000100:00100000:2.0:1788574400.110305:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669060352 00000100:00100000:2.0:1788574400.110309:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669060352 00000100:00100000:2.0:1788574400.110329:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669060736 00000100:00100000:2.0:1788574400.110332:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669060736 00000100:00100000:2.0:1788574400.110347:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669060864 00000100:00100000:2.0:1788574400.110349:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669060864 00000100:00100000:2.0:1788574400.110367:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:2.0:1788574400.110380:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:2395:x1875455669060352:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574400.110491:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:2395:x1875455669060352:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 113us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574400.110500:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:2.0:1788574400.110531:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:2.0:1788574400.110537:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2392:x1875455669060224:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:2.0:1788574400.110563:0:19093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d548 00000100:00080000:2.0:1788574400.110581:0:19093:0:(import.c:65:import_set_state_nolock()) ffff9c85c5f11800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788574400.110835:0:19093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788574400.111007:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+2:2392:x1875455669060224:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 469us (6242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574400.111014:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:2.0:1788574400.111029:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:2.0:1788574400.111035:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:408a814b-bde8-48f8-9467-4baee1a765d4+5:2392:x1875455669060736:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:2.0:1788574400.111049:0:19093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d587 00000100:00080000:2.0:1788574400.111056:0:19093:0:(import.c:65:import_set_state_nolock()) ffff9c84c325d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788574400.111081:0:19093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788574400.111137:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:408a814b-bde8-48f8-9467-4baee1a765d4+2:2392:x1875455669060736:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 101us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574400.111144:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:2.0:1788574400.111156:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:2.0:1788574400.111163:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:408a814b-bde8-48f8-9467-4baee1a765d4+5:2392:x1875455669060864:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:2.0:1788574400.111175:0:19093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d58e 00000100:00080000:2.0:1788574400.111183:0:19093:0:(import.c:65:import_set_state_nolock()) ffff9c84c2215000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788574400.111234:0:19093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788574400.111309:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:408a814b-bde8-48f8-9467-4baee1a765d4+2:2392:x1875455669060864:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 146us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574400.111316:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00010000:00010000:2.0:1788574400.111466:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574400.111986:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574400.112003:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669060480 00000100:00100000:3.0:1788574400.112010:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669060480 00000100:00100000:3.0:1788574400.112061:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669060608 00000100:00100000:3.0:1788574400.112064:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669060608 00000100:00100000:3.0:1788574400.112091:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:3.0:1788574400.112099:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+6:2395:x1875455669060480:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574400.112151:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+6:2395:x1875455669060480:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 52us (3029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574400.112159:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:3.0:1788574400.112173:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:3.0:1788574400.112179:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+5:2395:x1875455669060608:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574400.112239:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+5:2395:x1875455669060608:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 60us (3090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574400.112246:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00080000:3.0:1788574400.112271:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574400.112277:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574400.112279:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788574400.112283:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574400.470386:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574400.470662:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669060992 00000100:00100000:0.0:1788574400.470676:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669060992 00000100:00100000:0.0:1788574400.470746:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:0.0:1788574400.470758:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+12:15572:x1875455669060992:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788574400.470907:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+12:15572:x1875455669060992:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 Request processed in 150us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574400.470915:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:3.0:1788574400.487330:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574400.487435:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669061120 00000100:00100000:1.0:1788574400.487449:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669061120 00000100:00100000:1.0:1788574400.487531:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:1.0:1788574400.487544:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:15572:x1875455669061120:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788574400.487711:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:15572:x1875455669061120:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 Request processed in 169us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574400.487721:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:3.0:1788574400.494264:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574400.494401:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669061376 00000100:00100000:1.0:1788574400.494414:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669061376 00000100:00100000:1.0:1788574400.494491:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:1.0:1788574400.494504:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c36d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+12:15572:x1875455669061376:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788574400.494840:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c36d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+13:15572:x1875455669061376:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 337us (589us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1788574400.494850:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:3.0:1788574400.659500:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574400.659532:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681721216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574400.659633:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574400.660017:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574400.660029:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681721344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574400.660069:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574400.660110:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681721216 00000100:00100000:2.0:1788574400.660119:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681721216 00000100:00100000:2.0:1788574400.660166:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681721344 00000100:00100000:2.0:1788574400.660168:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681721344 00000100:00100000:2.0:1788574400.660182:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788574400.660221:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681721216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788574400.660265:0:17073:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788574400.660381:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788574400.660392:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681721344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788574400.660412:0:17807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788574400.660460:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681721344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574400.660468:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788574400.661182:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681721216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 988us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574400.661229:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788574400.661830:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681721216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574400.661996:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681721344:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788574400.981154:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574401.171957:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574401.171987:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681721472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574401.172092:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574401.172297:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681721472 00000100:00100000:1.0:1788574401.172310:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681721472 00000100:00100000:1.0:1788574401.172396:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788574401.172408:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681721472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574401.172451:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788574401.172511:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681721472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574401.172539:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788574401.172780:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574401.172831:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681721472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574401.683482:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574401.683515:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681721600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574401.683616:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574401.683737:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681721600 00000100:00100000:1.0:1788574401.683747:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681721600 00000100:00100000:1.0:1788574401.683812:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788574401.683824:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681721600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574401.683861:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788574401.683916:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681721600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574401.683925:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788574401.683972:0:3618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1788574401.683979:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c85f6671c00, transno 8589934596 00000004:00080000:1.0:1788574401.683990:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1788574401.684025:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681721600:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788574401.684295:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574401.684600:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681721856:0@lo:400:kworker.0 00000100:00100000:3.0:1788574401.684666:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574401.684710:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681722368:0@lo:400:kworker.0 00000100:00100000:3.0:1788574401.684736:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574401.684751:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681722880:0@lo:400:kworker.0 00000100:00100000:3.0:1788574401.684776:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574401.684797:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788574401.684803:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681721984:0@lo:400:kworker.0 00000100:00100000:3.0:1788574401.684886:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574401.684903:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681722496:0@lo:400:kworker.0 00000100:00100000:3.0:1788574401.684922:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574401.684937:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681723008:0@lo:400:kworker.0 00000100:00100000:3.0:1788574401.684960:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574401.684992:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681721856 00000100:00100000:3.0:1788574401.684998:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681721856 00000100:00100000:3.0:1788574401.685037:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788574401.685045:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681721856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574401.685115:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681721856:12345-0@lo:400:kworker.0 Request processed in 70us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574401.685123:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788574401.685151:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681722880 00000100:00100000:3.0:1788574401.685155:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681722880 00000100:00100000:3.0:1788574401.685222:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681721984 00000100:00100000:3.0:1788574401.685226:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681721984 00000100:00100000:3.0:1788574401.685240:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681722496 00000100:00100000:3.0:1788574401.685243:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681722496 00000100:00100000:3.0:1788574401.685253:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681723008 00000100:00100000:3.0:1788574401.685255:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681723008 00000100:00100000:3.0:1788574401.685269:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788574401.685275:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681722880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574401.685307:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681722880:12345-0@lo:400:kworker.0 Request processed in 32us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574401.685313:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788574401.685325:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788574401.685331:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681721984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574401.685353:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681721984:12345-0@lo:400:kworker.0 Request processed in 24us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574401.685359:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788574401.685369:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788574401.685374:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681722496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574401.685397:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681722496:12345-0@lo:400:kworker.0 Request processed in 23us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574401.685402:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788574401.685413:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788574401.685426:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681723008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574401.685453:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681723008:12345-0@lo:400:kworker.0 Request processed in 28us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574401.685459:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788574401.685480:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574401.685484:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574401.685511:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681721984:0@lo:400:kworker.0 00000100:00100000:3.0:1788574401.685522:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681722496:0@lo:400:kworker.0 00010000:00080000:3.0:1788574401.685534:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de939500 x1875455681723008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574401.685545:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681723008:0@lo:400:kworker.0 00000100:00100000:3.0:1788574401.685555:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681721856:0@lo:400:kworker.0 00000100:00100000:3.0:1788574401.685565:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681722880:0@lo:400:kworker.0 00000100:00100000:2.0:1788574401.685888:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681722368 00000100:00100000:2.0:1788574401.685894:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681722368 00000100:00100000:2.0:1788574401.685948:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788574401.685955:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681722368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574401.686000:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681722368:12345-0@lo:400:kworker.0 Request processed in 46us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574401.686007:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788574401.686137:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681722112:0@lo:400:kworker.0 00000100:00100000:0.0:1788574401.686230:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574401.686254:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681722624:0@lo:400:kworker.0 00000100:00100000:0.0:1788574401.686283:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574401.686301:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681723136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574401.686325:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574401.686349:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788574401.686356:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681721728:0@lo:400:kworker.0 00000100:00100000:0.0:1788574401.686387:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574401.686422:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681722240:0@lo:400:kworker.0 00000100:00100000:0.0:1788574401.686447:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574401.686464:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681722752:0@lo:400:kworker.0 00000100:00100000:0.0:1788574401.686485:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574401.686797:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681722624 00000100:00100000:0.0:1788574401.686804:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681722624 00000100:00100000:0.0:1788574401.686833:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681722752 00000100:00100000:0.0:1788574401.686836:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681722752 00000100:00100000:0.0:1788574401.686852:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788574401.686872:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681722624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574401.686917:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681722624:12345-0@lo:400:kworker.0 Request processed in 46us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574401.686924:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788574401.686939:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788574401.686945:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681722752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574401.686971:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681722752:12345-0@lo:400:kworker.0 Request processed in 27us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574401.686977:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788574401.686996:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681721728 00000100:00100000:0.0:1788574401.686999:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681721728 00000100:00100000:0.0:1788574401.687024:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788574401.687031:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+24:3617:x1875455681721728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574401.687061:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+24:3617:x1875455681721728:12345-0@lo:400:kworker.0 Request processed in 31us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574401.687067:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788574401.687127:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681721728:0@lo:400:kworker.0 00010000:00080000:0.0:1788574401.687142:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de939c00 x1875455681722752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574401.687154:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681722752:0@lo:400:kworker.0 00000100:00100000:0.0:1788574401.687163:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681722624:0@lo:400:kworker.0 00000100:00100000:0.0:1788574401.687241:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681723136 00000100:00100000:0.0:1788574401.687245:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681723136 00000100:00100000:0.0:1788574401.687269:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788574401.687276:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681723136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788574401.687300:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788574401.687341:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681723136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574401.687348:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788574401.687378:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681723136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574401.687482:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681722112 00000100:00100000:2.0:1788574401.687487:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681722112 00000100:00100000:2.0:1788574401.687527:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788574401.687536:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681722112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574401.687585:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681722112:12345-0@lo:400:kworker.0 Request processed in 49us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574401.687598:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788574401.687643:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681722112:0@lo:400:kworker.0 00000100:00100000:3.0:1788574401.688237:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681722240 00000100:00100000:3.0:1788574401.688244:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681722240 00000100:00100000:3.0:1788574401.688302:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788574401.688310:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681722240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574401.688368:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681722240:12345-0@lo:400:kworker.0 Request processed in 60us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574401.688375:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788574401.688401:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574401.688406:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574401.688408:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574401.688410:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574401.688438:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681722368:0@lo:400:kworker.0 00000100:00100000:2.0:1788574401.690989:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681722240:0@lo:400:kworker.0 00010000:00010000:3.0:1788574402.003848:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574402.643483:0:17104:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788574402.643499:0:17104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574402.643530:0:17104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788574402.643543:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788574403.030471:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574404.051714:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574404.244519:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681723264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574404.244591:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574404.244682:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681723264 00000100:00100000:0.0:1788574404.244691:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681723264 00000100:00100000:0.0:1788574404.244760:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788574404.244771:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681723264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788574404.244802:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788574404.244848:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681723264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574404.244856:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788574404.244911:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574404.244947:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681723264:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1788574404.294015:0:20440:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 22:13:22 (1788574402) 00000001:00080000:2.0:1788574404.757656:0:17047:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:2.0:1788574404.757765:0:17047:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:3.0:1788574404.757839:0:17105:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:3.0:1788574404.757850:0:17105:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00010000:00010000:2.0:1788574405.075542:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574405.192924:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574405.192975:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574405.192998:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574405.193015:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574405.193038:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574405.193080:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574405.193106:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669061760 00000100:00100000:1.0:1788574405.193124:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669061760 00000100:00100000:1.0:1788574405.193177:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669062016 00000100:00100000:1.0:1788574405.193180:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669062016 00000100:00100000:1.0:1788574405.193219:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669061632 00000100:00100000:1.0:1788574405.193222:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669061632 00000100:00100000:1.0:1788574405.193234:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669062144 00000100:00100000:1.0:1788574405.193237:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669062144 00000100:00100000:1.0:1788574405.193252:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:1.0:1788574405.193262:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2396:x1875455669061760:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574405.193341:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2396:x1875455669061760:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 80us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574405.193350:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:1.0:1788574405.193369:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:1.0:1788574405.193375:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+6:2396:x1875455669062016:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574405.193401:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+6:2396:x1875455669062016:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574405.193407:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:1.0:1788574405.193419:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:1.0:1788574405.193426:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+12:2396:x1875455669061632:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574405.193451:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+12:2396:x1875455669061632:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574405.193457:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:1.0:1788574405.193470:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:1.0:1788574405.193476:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+5:2396:x1875455669062144:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574405.193508:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+5:2396:x1875455669062144:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 32us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574405.193515:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:1.0:1788574405.193538:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669061888 00000100:00100000:1.0:1788574405.193542:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669061888 00000100:00100000:1.0:1788574405.193571:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:1.0:1788574405.193577:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:2396:x1875455669061888:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574405.193603:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:2396:x1875455669061888:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574405.193609:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00080000:1.0:1788574405.193626:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574405.193630:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574405.193632:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788574405.193870:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669061504 00000100:00100000:2.0:1788574405.193875:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669061504 00000100:00100000:2.0:1788574405.193922:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 172 00000100:00100000:2.0:1788574405.193930:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:2396:x1875455669061504:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574405.193967:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:2396:x1875455669061504:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 38us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574405.193973:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 172 00000100:00100000:2.0:1788574405.779499:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681723392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574405.779578:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574405.779663:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681723392 00000100:00100000:2.0:1788574405.779671:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681723392 00000100:00100000:2.0:1788574405.779731:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788574405.779740:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681723392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788574405.779787:0:17073:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788574405.779845:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681723392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574405.779853:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788574405.779899:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681723392:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1788574405.781797:0:19386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 408a814b-bde8-48f8-9467-4baee1a765d4 00000020:00000080:0.0:1788574405.781807:0:19386:0:(genops.c:885:class_export_put()) final put ffff9c84c2211000/408a814b-bde8-48f8-9467-4baee1a765d4 00000020:00000080:1.0:1788574405.781922:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c2211000/408a814b-bde8-48f8-9467-4baee1a765d4 for lustre-OST0001 00000020:00000080:1.0:1788574405.781977:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c2215000 for lustre-OST0001 00000100:00100000:1.0:1788574405.781993:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574405.782016:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681723520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574405.782080:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574405.782218:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681723520 00000100:00100000:0.0:1788574405.782227:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681723520 00000100:00100000:0.0:1788574405.782273:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788574405.782283:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681723520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574405.782326:0:17807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788574405.782378:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681723520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574405.782385:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788574405.782431:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681723520:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788574405.782849:0:18568:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 408a814b-bde8-48f8-9467-4baee1a765d4 00000020:00000080:2.0:1788574405.782855:0:18568:0:(genops.c:885:class_export_put()) final put ffff9c84c325a000/408a814b-bde8-48f8-9467-4baee1a765d4 00000001:00100000:2.0:1788574405.782870:0:18568:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 74bce780-6a9f-42e0-9637-fe6b1665ce5b 00000020:00000080:2.0:1788574405.782873:0:18568:0:(genops.c:885:class_export_put()) final put ffff9c85c5f13000/74bce780-6a9f-42e0-9637-fe6b1665ce5b 00000020:00000080:2.0:1788574405.782887:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c325a000/408a814b-bde8-48f8-9467-4baee1a765d4 for lustre-OST0000 00000020:00000080:2.0:1788574405.782918:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c5f13000/74bce780-6a9f-42e0-9637-fe6b1665ce5b for lustre-OST0000 00000020:00000080:2.0:1788574405.782935:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c325d800 for lustre-OST0000 00000020:00000080:2.0:1788574405.782939:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85c5f11800 for lustre-OST0000 00010000:00010000:3.0:1788574406.104156:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574406.292224:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574406.294491:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681723648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574406.294567:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574406.295879:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681723648 00000100:00100000:1.0:1788574406.295891:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681723648 00000100:00100000:1.0:1788574406.296012:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788574406.296023:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681723648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574406.296057:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788574406.296137:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681723648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574406.296144:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788574406.296207:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574406.301826:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681723648:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788574406.676154:0:17820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788574406.804451:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681723776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574406.804521:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574406.805158:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681723904:0@lo:400:kworker.0 00000100:00100000:0.0:1788574406.805216:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574406.805400:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681724032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574406.805430:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574406.805480:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681723776 00000100:00100000:3.0:1788574406.805487:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681723776 00000100:00100000:3.0:1788574406.805533:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681724032 00000100:00100000:3.0:1788574406.805536:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681724032 00000100:00100000:3.0:1788574406.805553:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788574406.805561:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681723776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574406.805718:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788574406.805767:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681723776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 206us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574406.805781:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788574406.805798:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788574406.805804:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681724032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788574406.805814:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788574406.805842:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681724032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574406.805960:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681723904 00000100:00100000:0.0:1788574406.805964:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681723904 00000100:00100000:0.0:1788574406.805993:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788574406.806000:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+24:3619:x1875455681723904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574406.806034:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+24:3619:x1875455681723904:12345-0@lo:400:kworker.0 Request processed in 35us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574406.806040:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788574406.806082:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681723904:0@lo:400:kworker.0 00000100:00080000:2.0:1788574406.806215:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574406.806255:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681723776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574406.806296:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681724032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574406.806976:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788574406.807513:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681724416:0@lo:400:kworker.0 00000100:00100000:0.0:1788574406.807567:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574406.808012:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681724928:0@lo:400:kworker.0 00000100:00100000:0.0:1788574406.808042:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574406.808070:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788574406.808076:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681724544:0@lo:400:kworker.0 00000100:00100000:0.0:1788574406.808115:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574406.808137:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681725056:0@lo:400:kworker.0 00000100:00100000:0.0:1788574406.808157:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574406.808186:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681724544 00000100:00100000:0.0:1788574406.808210:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681724544 00000100:00100000:1.0:1788574406.808392:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681724928 00000100:00100000:1.0:1788574406.808396:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681724928 00000100:00100000:1.0:1788574406.808440:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681725056 00000100:00100000:1.0:1788574406.808443:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681725056 00000100:00100000:1.0:1788574406.808465:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788574406.808473:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681724928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574406.808526:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681724928:12345-0@lo:400:kworker.0 Request processed in 54us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574406.808533:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788574406.808547:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788574406.808553:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681725056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574406.808594:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681725056:12345-0@lo:400:kworker.0 Request processed in 41us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574406.808600:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788574406.808941:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681725056:0@lo:400:kworker.0 00010000:00080000:1.0:1788574406.808958:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c335fb80 x1875455681724928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574406.808967:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681724928:0@lo:400:kworker.0 00000100:00100000:3.0:1788574406.809330:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681724416 00000100:00100000:3.0:1788574406.809350:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681724416 00000100:00100000:3.0:1788574406.809394:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788574406.809401:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681724416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574406.809453:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681724416:12345-0@lo:400:kworker.0 Request processed in 53us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574406.809459:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788574406.809751:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681724416:0@lo:400:kworker.0 00000100:00100000:2.0:1788574406.809833:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681724160:0@lo:400:kworker.0 00000100:00100000:2.0:1788574406.809940:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574406.809969:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681724672:0@lo:400:kworker.0 00000100:00100000:2.0:1788574406.809991:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574406.810013:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681725184:0@lo:400:kworker.0 00000100:00100000:2.0:1788574406.810036:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574406.810058:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788574406.810072:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681724288:0@lo:400:kworker.0 00000100:00100000:2.0:1788574406.810112:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574406.810129:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681724800:0@lo:400:kworker.0 00000100:00100000:2.0:1788574406.810150:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574406.810185:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681724672 00000100:00100000:2.0:1788574406.810213:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681724672 00000100:00100000:1.0:1788574406.810401:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681724160 00000100:00100000:1.0:1788574406.810406:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681724160 00000100:00100000:1.0:1788574406.810439:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788574406.810446:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681724160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574406.810502:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681724160:12345-0@lo:400:kworker.0 Request processed in 56us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574406.810508:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788574406.810540:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681724160:0@lo:400:kworker.0 00000100:00100000:3.0:1788574406.810827:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681725184 00000100:00100000:3.0:1788574406.810832:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681725184 00000100:00100000:0.0:1788574406.810979:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788574406.810987:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681724544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574406.811041:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681724544:12345-0@lo:400:kworker.0 Request processed in 55us (2924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574406.811048:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788574406.811081:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681724544:0@lo:400:kworker.0 00000100:00100000:0.0:1788574406.811142:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681724288 00000100:00100000:0.0:1788574406.811145:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681724288 00000100:00100000:0.0:1788574406.811168:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681724800 00000100:00100000:0.0:1788574406.811171:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681724800 00000100:00100000:0.0:1788574406.811208:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788574406.811215:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681724288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574406.811437:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788574406.811444:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681724800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574406.811485:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681724800:12345-0@lo:400:kworker.0 Request processed in 42us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574406.811492:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788574406.811505:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788574406.811511:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681724672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574406.811538:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681724672:12345-0@lo:400:kworker.0 Request processed in 28us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574406.811544:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788574406.812032:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788574406.812041:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681725184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574406.812078:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681725184:12345-0@lo:400:kworker.0 Request processed in 40us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574406.812097:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1788574406.813056:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574406.813064:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574406.813068:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788574406.813157:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681724800:0@lo:400:kworker.0 00000100:00100000:2.0:1788574406.813181:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681724672:0@lo:400:kworker.0 00010000:00080000:2.0:1788574406.813209:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de939c00 x1875455681725184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574406.813219:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681725184:0@lo:400:kworker.0 00000100:00100000:0.0:1788574406.813811:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681724288:12345-0@lo:400:kworker.0 Request processed in 2595us (3696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574406.813821:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788574406.813958:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681724288:0@lo:400:kworker.0 00010000:00010000:2.0:1788574407.132589:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574408.149757:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574408.748954:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574408.748993:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574408.749024:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574408.749099:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669062272 00000100:00100000:0.0:1788574408.749118:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669062400 00000100:00100000:2.0:1788574408.749122:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669062272 00000100:00100000:0.0:1788574408.749126:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669062400 00000100:00100000:2.0:1788574408.749177:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669062528 00000100:00100000:2.0:1788574408.749183:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669062528 00000100:00100000:0.0:1788574408.749183:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1788574408.754414:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2337100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1980da70-ec0a-4d33-8959-8ff61c9350d5+15:2393:x1875455669062272:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574408.754445:0:17053:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574408.754674:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8d525 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b3e expref: 15 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574408.754696:0:17053:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574408.755081:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2337100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1980da70-ec0a-4d33-8959-8ff61c9350d5+14:2393:x1875455669062272:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 5855us (6147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574408.755093:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1788574408.755140:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1788574408.755151:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2337800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:2393:x1875455669062400:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574408.755175:0:17053:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574408.755187:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8d52c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b6f expref: 13 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574408.755241:0:17053:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574408.755263:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2337800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1980da70-ec0a-4d33-8959-8ff61c9350d5+12:2393:x1875455669062400:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 115us (6269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574408.755269:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1788574408.755289:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1788574408.755295:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1980da70-ec0a-4d33-8959-8ff61c9350d5+11:2394:x1875455669062528:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574408.755303:0:17053:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574408.755312:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8d5e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c25 expref: 11 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574408.755321:0:17053:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574408.755337:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1980da70-ec0a-4d33-8959-8ff61c9350d5+10:2394:x1875455669062528:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 42us (6312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574408.755342:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:2.0:1788574408.765540:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574408.765712:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669062784 00000100:00100000:1.0:1788574408.765723:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669062784 00000100:00100000:1.0:1788574408.765813:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:1.0:1788574408.765934:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:2392:x1875455669062784:12345-192.168.204.51@tcp:9:umount.0 00000020:00000080:1.0:1788574408.765976:0:19093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d54f 00000020:00010000:1.0:1788574408.765985:0:19093:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c85c5f12800: total 0 00000100:00080000:1.0:1788574408.765990:0:19093:0:(import.c:65:import_set_state_nolock()) ffff9c85c5f10800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788574408.766062:0:19093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1788574408.766252:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+4:2392:x1875455669062784:12345-192.168.204.51@tcp:9:umount.0 Request processed in 429us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574408.766261:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000020:00010000:0.0:1788574408.766674:0:17056:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c85c5f12800: total 0 00010000:00010000:0.0:1788574408.766679:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574408.766746:0:17056:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c85c5f12800, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1788574408.766781:0:17056:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788574408.766785:0:17056:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788574408.766812:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d8ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d05 expref: 3 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574408.766945:0:17056:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c85c5f12800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788574408.766966:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574408.766968:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574408.766969:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574408.767254:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574408.795356:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574408.795459:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669063680 00000100:00100000:2.0:1788574408.795469:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669063680 00000100:00100000:2.0:1788574408.795549:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:2.0:1788574408.795560:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+12:2392:x1875455669063680:12345-192.168.204.51@tcp:39:umount.0 00000020:00000080:2.0:1788574408.795592:0:18898:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d53a 00000020:00010000:2.0:1788574408.795786:0:18898:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c85c6e7b800: total 0 00000100:00080000:2.0:1788574408.795792:0:18898:0:(import.c:65:import_set_state_nolock()) ffff9c85c6e7d000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788574408.795859:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:2.0:1788574408.796443:0:18898:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934635 00000100:00100000:2.0:1788574408.796647:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+11:2392:x1875455669063680:12345-192.168.204.51@tcp:39:umount.0 Request processed in 1087us (1297us total) trans 8589934636 rc 0/0 00000100:00100000:2.0:1788574408.796658:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00000020:00010000:3.0:1788574408.806564:0:17055:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c85c6e7b800: total 0 00000100:00100000:1.0:1788574408.806759:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574408.806832:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669063808 00000100:00100000:2.0:1788574408.806841:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669063808 00000100:00100000:2.0:1788574408.806894:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:2.0:1788574408.806904:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2392:x1875455669063808:12345-192.168.204.51@tcp:39:umount.0 00000020:00000080:2.0:1788574408.806932:0:17068:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d541 00000100:00080000:2.0:1788574408.806948:0:17068:0:(import.c:65:import_set_state_nolock()) ffff9c85fbbdf800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788574408.806968:0:17068:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788574408.807187:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+3:2392:x1875455669063808:12345-192.168.204.51@tcp:39:umount.0 Request processed in 283us (432us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788574408.807224:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00080000:1.0:1788574408.807424:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788574408.807771:0:17055:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c85c6e7b800, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1788574408.807813:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c85d10a6100) 00010000:00010000:3.0:1788574408.807817:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788574408.807825:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d866 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ce2 expref: 10 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.807847:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:3.0:1788574408.807849:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574408.807853:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3200/0x5bf8706fdac8d621 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c33 expref: 9 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.807868:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85cbaaf300) 00010000:00010000:3.0:1788574408.807870:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574408.807881:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8d660 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c41 expref: 8 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.807895:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:3.0:1788574408.807897:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788574408.807901:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8d80b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ccd expref: 7 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.807910:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:3.0:1788574408.807912:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788574408.807916:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d8cf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d0c expref: 6 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.807928:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c84c34f0800) 00010000:00010000:3.0:1788574408.807930:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574408.807933:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8d605 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c2c expref: 5 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.807945:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:3.0:1788574408.807947:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788574408.807950:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d6e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c6b expref: 4 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574408.807961:0:17055:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c85c6e7b800, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1788574408.807974:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574408.807976:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574408.807978:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574408.811798:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574409.172070:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574409.363973:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681725312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574409.364065:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574409.365969:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681725312 00000100:00100000:0.0:1788574409.365982:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681725312 00000100:00100000:0.0:1788574409.366080:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788574409.366094:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681725312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788574409.366127:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788574409.366229:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681725312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 140us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574409.366237:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788574409.366317:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681725312:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788574409.366677:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788574410.195350:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574410.313924:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574410.314048:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574410.314085:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574410.314138:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669063936 00000100:00100000:2.0:1788574410.314170:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669063936 00000100:00100000:2.0:1788574410.314243:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 174 00000100:00100000:2.0:1788574410.314253:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+10:2395:x1875455669063936:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574410.314314:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+10:2395:x1875455669063936:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 63us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574410.314323:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 174 00000100:00100000:3.0:1788574410.326775:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669064064 00000100:00100000:3.0:1788574410.326810:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669064064 00000100:00100000:3.0:1788574410.326894:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669064192 00000100:00100000:3.0:1788574410.326899:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669064192 00000100:00100000:3.0:1788574410.326928:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:3.0:1788574410.326939:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+6:2395:x1875455669064064:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574410.327026:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+6:2395:x1875455669064064:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 80us (13101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574410.327034:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:3.0:1788574410.327051:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:3.0:1788574410.327057:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+5:2395:x1875455669064192:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574410.327080:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+5:2395:x1875455669064192:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 25us (12995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574410.327086:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00080000:1.0:1788574410.327294:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574410.327299:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574410.899580:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681725440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574410.899687:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574410.899848:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574410.899855:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681725568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574410.899882:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574410.909533:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681725440 00000100:00100000:2.0:1788574410.909557:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681725440 00000100:00100000:2.0:1788574410.909662:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681725568 00000100:00100000:2.0:1788574410.909667:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681725568 00000100:00100000:2.0:1788574410.909693:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788574410.909704:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681725440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788574410.909756:0:17807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788574410.909871:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681725440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 168us (10183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574410.909878:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788574410.909899:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788574410.909905:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681725568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788574410.909922:0:17807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788574410.909951:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681725568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (10068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574410.909956:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788574410.910122:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681725568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574410.910140:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681725440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574410.955056:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574410.955221:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669064320 00000100:00100000:2.0:1788574410.955237:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669064320 00000100:00100000:2.0:1788574410.955335:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1788574410.955347:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1980da70-ec0a-4d33-8959-8ff61c9350d5+10:2394:x1875455669064320:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574410.956686:0:17054:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574410.956719:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea2800/0x5bf8706fdac8d564 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6bae expref: 10 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574410.956740:0:17054:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574410.956899:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1980da70-ec0a-4d33-8959-8ff61c9350d5+9:2394:x1875455669064320:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1553us (1851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574410.956909:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1788574410.986610:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574410.986795:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669064576 00000100:00100000:2.0:1788574410.986810:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669064576 00000100:00100000:2.0:1788574410.986890:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1788574410.986904:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1980da70-ec0a-4d33-8959-8ff61c9350d5+9:2396:x1875455669064576:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574410.986924:0:17053:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574410.986950:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8d5e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c1e expref: 9 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574410.986971:0:17053:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574410.987042:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1980da70-ec0a-4d33-8959-8ff61c9350d5+8:2396:x1875455669064576:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 142us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574410.987051:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:0.0:1788574410.987163:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574410.987338:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669064448 00000100:00100000:2.0:1788574410.987342:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669064448 00000100:00100000:2.0:1788574410.987366:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1788574410.987372:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1980da70-ec0a-4d33-8959-8ff61c9350d5+8:2394:x1875455669064448:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574410.987380:0:17053:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574410.987390:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8d56b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6bdf expref: 8 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574410.988879:0:17053:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574410.988964:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1980da70-ec0a-4d33-8959-8ff61c9350d5+7:2394:x1875455669064448:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1584us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574410.988977:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:3.0:1788574410.989649:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574410.990218:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669064832 00000100:00100000:2.0:1788574410.990232:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669064832 00000100:00100000:2.0:1788574410.990301:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:2.0:1788574410.990311:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+6:2392:x1875455669064832:12345-192.168.204.51@tcp:39:umount.0 00000020:00000080:2.0:1788574410.990364:0:17069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d579 00000020:00010000:2.0:1788574410.990376:0:17069:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c85fbbdf000: total 0 00000100:00080000:2.0:1788574410.990382:0:17069:0:(import.c:65:import_set_state_nolock()) ffff9c85fbbdb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788574410.990414:0:17069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:2.0:1788574410.990583:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+5:2392:x1875455669064832:12345-192.168.204.51@tcp:39:umount.0 Request processed in 273us (943us total) trans 8589934637 rc 0/0 00000100:00100000:2.0:1788574410.990592:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 78 00000020:00010000:0.0:1788574410.990806:0:17055:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c85fbbdf000: total 0 00010000:00010000:0.0:1788574410.990812:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574410.990879:0:17055:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c85fbbdf000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788574410.990920:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85cbaaf300) 00010000:00010000:0.0:1788574410.990924:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574410.990933:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d66e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c48 expref: 4 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574410.990981:0:17055:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c85fbbdf000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788574410.990993:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574410.990995:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574410.990997:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574411.027977:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574411.031245:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669064960 00000100:00100000:2.0:1788574411.031267:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669064960 00000100:00100000:2.0:1788574411.031360:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:2.0:1788574411.031374:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:408a814b-bde8-48f8-9467-4baee1a765d4+5:2392:x1875455669064960:12345-192.168.204.51@tcp:39:umount.0 00000020:00000080:2.0:1788574411.031438:0:17068:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d580 00000100:00080000:2.0:1788574411.031455:0:17068:0:(import.c:65:import_set_state_nolock()) ffff9c85fbbdd000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788574411.031589:0:17068:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788574411.031826:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:408a814b-bde8-48f8-9467-4baee1a765d4+3:2392:x1875455669064960:12345-192.168.204.51@tcp:39:umount.0 Request processed in 454us (3865us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788574411.031836:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 79 00010000:00010000:1.0:1788574411.034679:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574411.089038:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574411.089513:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669065216 00000100:00100000:2.0:1788574411.089530:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669065216 00000100:00100000:2.0:1788574411.089617:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 175 00000100:00100000:2.0:1788574411.089630:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+7:2392:x1875455669065216:12345-192.168.204.51@tcp:251:umount.0 00000020:00000080:2.0:1788574411.089692:0:17062:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d517 00000020:00010000:2.0:1788574411.089702:0:17062:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c84c44b0800: total 0 00000100:00080000:2.0:1788574411.089708:0:17062:0:(import.c:65:import_set_state_nolock()) ffff9c84c44b5000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788574411.089812:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+3:2392:x1875455669065216:12345-192.168.204.51@tcp:251:umount.0 Request processed in 184us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574411.089821:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 175 00000020:00010000:0.0:1788574411.089960:0:17055:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c84c44b0800: total 0 00010000:00010000:0.0:1788574411.090054:0:17055:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c84c44b0800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788574411.090097:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217ee00/0x5bf8706fdac8d51e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b37 expref: 2 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574411.090113:0:17055:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c84c44b0800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788574411.090125:0:17055:0:(genops.c:885:class_export_put()) final put ffff9c84c44b0800/1980da70-ec0a-4d33-8959-8ff61c9350d5 00010000:00010000:0.0:1788574411.090149:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574411.090152:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574411.090155:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788574411.090935:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c44b0800/1980da70-ec0a-4d33-8959-8ff61c9350d5 for MGS 00000020:00000080:2.0:1788574411.090988:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c44b5000 for MGS 00010000:00010000:1.0:1788574411.219783:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574411.421012:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574411.421043:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681725696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574411.421147:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574411.421235:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681725696 00000100:00100000:2.0:1788574411.421244:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681725696 00000100:00100000:2.0:1788574411.421320:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788574411.421330:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681725696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574411.421368:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788574411.421418:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681725696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574411.421426:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788574411.421483:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681725696:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788574411.422141:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574411.926711:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681725824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574411.926809:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574411.926925:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681725824 00000100:00100000:2.0:1788574411.926935:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681725824 00000100:00100000:2.0:1788574411.927013:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788574411.927025:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681725824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574411.927061:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788574411.927109:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681725824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574411.927116:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788574411.927141:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574411.927248:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681725824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574411.930280:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681726080:0@lo:400:kworker.0 00000100:00100000:2.0:1788574411.930379:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574411.930435:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681726592:0@lo:400:kworker.0 00000100:00100000:2.0:1788574411.930457:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574411.930472:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6676680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681727104:0@lo:400:kworker.0 00000100:00100000:2.0:1788574411.930494:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574411.930519:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788574411.930524:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681725952:0@lo:400:kworker.0 00000100:00100000:2.0:1788574411.930550:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574411.930569:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681726464:0@lo:400:kworker.0 00000100:00100000:2.0:1788574411.930587:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574411.930601:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681726976:0@lo:400:kworker.0 00000100:00100000:2.0:1788574411.930618:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574411.930647:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681726080 00000100:00100000:2.0:1788574411.930654:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681726080 00000100:00100000:2.0:1788574411.931888:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788574411.931918:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681726080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574411.932030:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681726080:12345-0@lo:400:kworker.0 Request processed in 120us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574411.932038:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788574411.937856:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681726592 00000100:00100000:2.0:1788574411.937879:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681726592 00000100:00100000:2.0:1788574411.938050:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681726464 00000100:00100000:2.0:1788574411.938055:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681726464 00000100:00100000:0.0:1788574411.938110:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788574411.938124:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6675f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681726592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574411.938293:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6675f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681726592:12345-0@lo:400:kworker.0 Request processed in 173us (7833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574411.938303:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788574411.940291:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681727104 00000100:00100000:3.0:1788574411.940311:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681727104 00000100:00080000:1.0:1788574411.940386:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574411.940394:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574411.940397:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574411.941913:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788574411.941930:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681726464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574411.942058:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681726464:12345-0@lo:400:kworker.0 Request processed in 132us (11468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574411.942065:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788574411.942101:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681725952 00000100:00100000:2.0:1788574411.942110:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681725952 00000100:00100000:2.0:1788574411.942141:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788574411.942147:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+24:3620:x1875455681725952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574411.942182:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+24:3620:x1875455681725952:12345-0@lo:400:kworker.0 Request processed in 35us (11631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574411.942206:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788574411.942250:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681726976 00000100:00100000:2.0:1788574411.942254:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681726976 00000100:00100000:2.0:1788574411.942290:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788574411.942297:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681726976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574411.942330:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681726976:12345-0@lo:400:kworker.0 Request processed in 34us (11711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574411.942336:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788574411.942403:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681725952:0@lo:400:kworker.0 00000100:00100000:2.0:1788574411.942422:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681726464:0@lo:400:kworker.0 00010000:00080000:2.0:1788574411.942438:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85f6674e00 x1875455681726976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574411.942449:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681726976:0@lo:400:kworker.0 00000100:00100000:2.0:1788574411.942462:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681726080:0@lo:400:kworker.0 00000100:00100000:2.0:1788574411.942474:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681726592:0@lo:400:kworker.0 00000100:00080000:1.0:1788574411.942584:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574411.942729:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788574411.942738:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681727104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574411.942780:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681727104:12345-0@lo:400:kworker.0 Request processed in 44us (12285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574411.942786:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788574411.942822:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681726208:0@lo:400:kworker.0 00000100:00100000:3.0:1788574411.942861:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574411.942884:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681726720:0@lo:400:kworker.0 00000100:00100000:3.0:1788574411.942902:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574411.942914:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681727232:0@lo:400:kworker.0 00000100:00100000:3.0:1788574411.942932:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574411.942953:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788574411.942959:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681726336:0@lo:400:kworker.0 00000100:00100000:3.0:1788574411.942982:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574411.943013:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681726848:0@lo:400:kworker.0 00000100:00100000:3.0:1788574411.943034:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574411.943044:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681727360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574411.943064:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574411.943087:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681726208 00000100:00100000:3.0:1788574411.943091:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681726208 00000100:00100000:3.0:1788574411.943106:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681726720 00000100:00100000:3.0:1788574411.943109:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681726720 00000100:00100000:3.0:1788574411.943119:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681727232 00000100:00100000:3.0:1788574411.943122:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681727232 00000100:00100000:2.0:1788574411.943180:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681726848 00000100:00100000:2.0:1788574411.943184:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681726848 00000100:00080000:1.0:1788574411.945160:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574411.945172:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788574411.945217:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681726336 00000100:00100000:1.0:1788574411.945229:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681726336 00000100:00100000:1.0:1788574411.945303:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788574411.945315:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681726336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574411.945429:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681726336:12345-0@lo:400:kworker.0 Request processed in 116us (2443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574411.945437:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788574411.945495:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681726336:0@lo:400:kworker.0 00000100:00100000:3.0:1788574411.946849:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788574411.946861:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681726208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574411.946953:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681726208:12345-0@lo:400:kworker.0 Request processed in 94us (4091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574411.946960:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788574411.946976:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788574411.946982:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681726720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574411.947038:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681726720:12345-0@lo:400:kworker.0 Request processed in 55us (4134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574411.947044:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788574411.947056:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788574411.947063:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681727232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574411.947091:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681727232:12345-0@lo:400:kworker.0 Request processed in 29us (4156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574411.947096:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788574411.947587:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681726208:0@lo:400:kworker.0 00000100:00100000:1.0:1788574411.947601:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681726720:0@lo:400:kworker.0 00010000:00080000:1.0:1788574411.947616:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85f6676300 x1875455681727232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574411.947628:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681727232:0@lo:400:kworker.0 00000100:00100000:2.0:1788574411.947845:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788574411.947854:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681726848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574411.947907:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681726848:12345-0@lo:400:kworker.0 Request processed in 54us (4871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574411.947914:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788574411.947949:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681726848:0@lo:400:kworker.0 00000100:00100000:2.0:1788574411.947970:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681727360 00000100:00100000:2.0:1788574411.947977:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681727360 00000100:00100000:2.0:1788574411.948024:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788574411.948031:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681727360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788574411.948052:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788574411.948091:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681727360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (5026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574411.948097:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788574411.948129:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681727360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574411.949039:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6676680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681727104:0@lo:400:kworker.0 00010000:00010000:0.0:1788574412.243359:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574412.883505:0:17104:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788574412.883521:0:17104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574412.883548:0:17104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788574412.883559:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788574413.271614:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788574413.311388:0:20635:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788574413.332628:0:20635:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788574413.332695:0:20635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d0e1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.332710:0:20635:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d0e1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.332719:0:20635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d0e1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.332726:0:20635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d0e1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.332748:0:20635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788574413.332754:0:20635:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788574413.332782:0:20635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574413.332786:0:20635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788574413.332792:0:20635:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788574413.332818:0:20635:0:(import.c:65:import_set_state_nolock()) ffff9c85e0bc2800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788574413.333594:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875455681727488:0@lo:39:umount.0 00000100:00100000:2.0:1788574413.333679:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574413.333768:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681727488 00000100:00100000:2.0:1788574413.333775:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681727488 00000100:00100000:2.0:1788574413.333832:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788574413.333856:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875455681727488:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788574413.333884:0:17067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d10b 00000100:00080000:2.0:1788574413.333894:0:17067:0:(import.c:65:import_set_state_nolock()) ffff9c85fa0fa800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788574413.334611:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3616:x1875455681727488:12345-0@lo:39:umount.0 Request processed in 755us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574413.334622:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:2.0:1788574413.334635:0:17067:0:(genops.c:885:class_export_put()) final put ffff9c85e0bc4000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788574413.334704:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574413.334712:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d0e1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.334721:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616c00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574413.334726:0:17056:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d0e1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.334736:0:17056:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d0e1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574413.334745:0:17056:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d0e1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574413.334751:0:17056:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788574413.334754:0:17056:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788574413.334758:0:17056:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788574413.334792:0:17056:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d0e1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.334799:0:17056:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574413.334833:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d0e1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.334853:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d0e1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.334870:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574413.334873:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574413.334876:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788574413.334888:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85e0bc4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788574413.334947:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85fa0fa800 for lustre-MDT0000 00000100:00080000:2.0:1788574413.335013:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85e0bc2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788574413.335025:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875455681727488:0@lo:39:umount.0 00000100:00080000:2.0:1788574413.335609:0:20635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574413.335613:0:20635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788574413.335618:0:20635:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788574413.335712:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681727616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574413.335772:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788574413.337110:0:20635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d032 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337125:0:20635:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d032 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337133:0:20635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d032 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337139:0:20635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d032 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337162:0:20635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574413.337177:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574413.337217:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d032 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337224:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a3e00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574413.337228:0:17056:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d032 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337237:0:17056:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d032 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574413.337244:0:17056:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d032 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574413.337250:0:17056:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788574413.337252:0:17056:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788574413.337296:0:17056:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d032 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337303:0:17056:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574413.337318:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d032 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337324:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d032 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337339:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574413.337341:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574413.337343:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574413.337355:0:20635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d43e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337362:0:20635:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d43e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337375:0:20635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d43e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337381:0:20635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d43e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337391:0:20635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574413.337398:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574413.337401:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d43e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337407:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f600 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574413.337410:0:17056:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d43e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337416:0:17056:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d43e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574413.337423:0:17056:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d43e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574413.337428:0:17056:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788574413.337430:0:17056:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788574413.337432:0:17056:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788574413.337448:0:17056:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d43e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337454:0:17056:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574413.337469:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d43e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337481:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d43e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.337490:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574413.337492:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574413.337494:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574413.337509:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681727872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574413.337566:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574413.338864:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574413.338879:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681727744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574413.338936:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574413.339024:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681727616 00000100:00100000:1.0:1788574413.339032:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681727616 00000100:00100000:1.0:1788574413.339086:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681727872 00000100:00100000:1.0:1788574413.339089:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681727872 00000100:00100000:1.0:1788574413.339102:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681727744 00000100:00100000:1.0:1788574413.339104:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681727744 00000100:00100000:1.0:1788574413.339120:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574413.339128:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+26:3619:x1875455681727616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574413.339141:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574413.339159:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c84c2617a00/0x5bf8706fdac8d0e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d0da expref: 26 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574413.339173:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574413.339223:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+25:3619:x1875455681727616:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (3451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574413.339231:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574413.339284:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574413.339292:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6677480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+24:3617:x1875455681727872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574413.339299:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574413.339308:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d08a3400/0x5bf8706fdac8d43e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d437 expref: 24 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574413.339327:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574413.339351:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6677480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+23:3617:x1875455681727872:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574413.339368:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574413.339382:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788574413.339389:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+22:3619:x1875455681727744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574413.339397:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574413.339406:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c84c2617e00/0x5bf8706fdac8d032 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d02b expref: 22 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574413.339415:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574413.339436:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+21:3619:x1875455681727744:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574413.339442:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788574413.339607:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681727744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574413.339619:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681727616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574413.340590:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681727872:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574413.340639:0:20635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d5db expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.340650:0:20635:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d5db expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.340657:0:20635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d5db expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.340664:0:20635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d5db expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.340690:0:20635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574413.340697:0:20635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d024 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.340703:0:20635:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d024 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.340724:0:20635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d024 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.340729:0:20635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d024 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574413.340736:0:20635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788574413.340741:0:20635:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788574413.340745:0:20635:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788574413.340755:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574413.340761:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d5db expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574413.340768:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2800 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574413.340772:0:17056:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d5db expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574413.340780:0:17056:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d5db expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574413.340787:0:17056:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d5db expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788574413.340792:0:20635:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788574413.340795:0:20635:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788574413.340800:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:01000000:1.0:1788574413.340801:0:17056:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788574413.340804:0:17056:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000020:00000080:2.0:1788574413.340805:0:20635:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 10000000:01000000:1.0:1788574413.340805:0:17056:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:2.0:1788574413.340809:0:20635:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c84c34c4000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788574413.340815:0:20635:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c84c34c0800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788574413.340819:0:20635:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c85fa1ff000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788574413.340824:0:20635:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c8600d39000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788574413.340831:0:20635:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9c85fbbdf000 408a814b-bde8-48f8-9467-4baee1a765d4 192.168.204.51@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00010000:00010000:1.0:1788574413.340833:0:17056:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d5db expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788574413.340836:0:20635:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9c85c6e7b800 74bce780-6a9f-42e0-9637-fe6b1665ce5b 192.168.204.51@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934635 stale:0 00010000:00010000:1.0:1788574413.340839:0:17056:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:2.0:1788574413.340841:0:20635:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9c84c2513380) has exports, disconnecting them 00000020:00080000:2.0:1788574413.340845:0:20635:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c84c34c4000), last request at 1788574411 00000020:00000080:2.0:1788574413.340852:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d406 00010000:00010000:1.0:1788574413.340854:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d5db expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574413.340860:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d5db expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788574413.340869:0:20635:0:(import.c:65:import_set_state_nolock()) ffff9c84c34c5000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788574413.340871:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574413.340874:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d024 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574413.340879:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a3c00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574413.340882:0:17056:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d024 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574413.340889:0:17056:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d024 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574413.340894:0:17056:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d024 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574413.340900:0:17056:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788574413.340902:0:17056:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788574413.340903:0:17056:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00080000:2.0:1788574413.340908:0:20635:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c84c34c4000): rc 0 00000020:00000080:2.0:1788574413.340910:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c84c34c4000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1788574413.340922:0:17056:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d024 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788574413.340924:0:20635:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c84c34c0800), last request at 1788574411 00000020:00000080:2.0:1788574413.340927:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d2a8 00010000:00010000:1.0:1788574413.340928:0:17056:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:2.0:1788574413.340932:0:20635:0:(import.c:65:import_set_state_nolock()) ffff9c84c34c1800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788574413.340938:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d024 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788574413.340942:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c34c4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1788574413.340944:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d024 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574413.340952:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574413.340953:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574413.340955:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574413.340978:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681728128:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788574413.340990:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c34c5000 for lustre-MDT0000 00000020:00080000:2.0:1788574413.341003:0:20635:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c84c34c0800): rc 0 00000020:00000080:2.0:1788574413.341005:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c84c34c0800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788574413.341012:0:20635:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c85fa1ff000), last request at 1788574333 00000020:00000080:2.0:1788574413.341015:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d1f9 00000100:00080000:2.0:1788574413.341019:0:20635:0:(import.c:65:import_set_state_nolock()) ffff9c85fa1fc000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788574413.341030:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c34c0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788574413.341053:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c34c1800 for lustre-MDT0000 00000020:00080000:2.0:1788574413.341064:0:20635:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c85fa1ff000): rc 0 00000020:00000080:2.0:1788574413.341066:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85fa1ff000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788574413.341073:0:20635:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c8600d39000), last request at 1788574333 00000020:00000080:2.0:1788574413.341076:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d190 00000100:00080000:2.0:1788574413.341080:0:20635:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb1c800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788574413.341087:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fa1ff000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788574413.341111:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85fa1fc000 for lustre-MDT0000 00000001:00000004:2.0:1788574413.341121:0:20635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00100000:1.0:1788574413.341452:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574413.341633:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681728128 00000100:00100000:1.0:1788574413.341639:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681728128 00000100:00100000:1.0:1788574413.341762:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788574413.341771:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+21:3619:x1875455681728128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574413.341784:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574413.341798:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8d024 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d01d expref: 21 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574413.341812:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574413.341849:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+20:3619:x1875455681728128:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574413.341855:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788574413.341888:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681728128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574413.341904:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574413.341919:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574413.341928:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681728000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574413.341956:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788574413.342023:0:20635:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c8600d39000): rc 0 00000004:00000080:2.0:1788574413.342031:0:20635:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb4d287ac7ae0 00000100:00080000:2.0:1788574413.342050:0:20635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788574413.342054:0:20635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:1.0:1788574413.342794:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681728000 00000100:00100000:1.0:1788574413.342799:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681728000 00000100:00100000:1.0:1788574413.342834:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788574413.342842:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2337800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+20:3617:x1875455681728000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574413.342853:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574413.342865:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217ec00/0x5bf8706fdac8d5db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d5d4 expref: 20 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574413.342876:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574413.342909:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2337800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+19:3617:x1875455681728000:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574413.342915:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788574413.342945:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681728000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574413.343478:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574413.344004:0:20635:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788574413.344029:0:20635:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb61800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788574413.344147:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681728256:0@lo:39:umount.0 00000100:00100000:1.0:1788574413.344221:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574413.344405:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681728256 00000100:00100000:1.0:1788574413.344411:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681728256 00000100:00100000:1.0:1788574413.344492:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788574413.344501:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875455681728256:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788574413.344578:0:17807:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d223 00000100:00080000:1.0:1788574413.344588:0:17807:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb17800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788574413.344612:0:17807:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788574413.344757:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3616:x1875455681728256:12345-0@lo:39:umount.0 Request processed in 257us (535us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788574413.344777:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788574413.345181:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb61800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788574413.345207:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681728256:0@lo:39:umount.0 00010000:00010000:1.0:1788574413.345222:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574413.345308:0:20635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788574413.345312:0:20635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1788574413.345431:0:20635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788574413.345493:0:20635:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788574413.345510:0:20635:0:(import.c:65:import_set_state_nolock()) ffff9c85c4edd000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788574413.345524:0:20635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788574413.345527:0:20635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1788574413.345546:0:20635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788574413.345612:0:20635:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788574413.345623:0:20635:0:(import.c:65:import_set_state_nolock()) ffff9c84c369e000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788574413.345677:0:20635:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c84c2513380) has no exports 00000100:00100000:1.0:1788574413.345825:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681728384:0@lo:9:umount.0 00000100:00100000:1.0:1788574413.345866:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574413.345887:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681728512:0@lo:9:umount.0 00000100:00100000:1.0:1788574413.345907:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574413.345937:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681728384 00000100:00100000:1.0:1788574413.345942:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681728384 00000100:00100000:1.0:1788574413.345994:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681728512 00000100:00100000:1.0:1788574413.345997:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681728512 00000100:00100000:1.0:1788574413.346020:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788574413.346027:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875455681728384:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788574413.346048:0:18571:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d2f5 00000100:00080000:1.0:1788574413.346054:0:18571:0:(import.c:65:import_set_state_nolock()) ffff9c85c6e78000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788574413.346104:0:18571:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788574413.346246:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3616:x1875455681728384:12345-0@lo:9:umount.0 Request processed in 220us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574413.346267:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788574413.346283:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788574413.346296:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875455681728512:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788574413.346313:0:19093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d445 00000100:00080000:0.0:1788574413.346329:0:19093:0:(import.c:65:import_set_state_nolock()) ffff9c84c44b0000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788574413.346365:0:19093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1788574413.346452:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3616:x1875455681728512:12345-0@lo:9:umount.0 Request processed in 160us (544us total) trans 0 rc 0/0 00010000:00010000:1.0:1788574413.347182:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788574413.347250:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85c4edd000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788574413.347263:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788574413.347265:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788574413.347269:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681728384:0@lo:9:umount.0 00000100:00080000:1.0:1788574413.347281:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c369e000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788574413.347298:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788574413.347300:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788574413.347303:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681728512:0@lo:9:umount.0 00000100:00100000:0.0:1788574413.347427:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788574413.347456:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574413.347461:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788574413.347543:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788574413.360625:0:20635:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c84c2513380) has no exports 00000020:00000080:0.0:1788574413.392657:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d078 00000020:00000080:0.0:1788574413.392676:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85fa22f000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788574413.392745:0:20635:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788574413.392814:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fa22f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788574413.393443:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574413.393455:0:20635:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788574413.393461:0:20635:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9c84c303b380) has no exports 00000020:00000080:1.0:1788574413.393861:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d071 00000020:00000080:1.0:1788574413.393869:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85f6ded800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788574413.393926:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574413.393933:0:20635:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788574413.393936:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85f6dea000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788574413.393938:0:20635:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85f6dea000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788574413.393946:0:20635:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788574413.394029:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85f6ded800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788574414.291358:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574414.483428:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681728640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574414.483538:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574414.483645:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681728640 00000100:00100000:2.0:1788574414.483655:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681728640 00000100:00100000:2.0:1788574414.483732:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788574414.483742:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681728640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788574414.483774:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788574414.483854:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681728640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574414.483861:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788574414.483969:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574414.484006:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681728640:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1788574414.998445:0:19386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788574414.998456:0:19386:0:(genops.c:885:class_export_put()) final put ffff9c84c44b1800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788574415.005248:0:17047:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788574415.005257:0:17047:0:(genops.c:885:class_export_put()) final put ffff9c8600d39000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788574415.005291:0:17047:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 408a814b-bde8-48f8-9467-4baee1a765d4 00000001:00080000:1.0:1788574415.005299:0:17047:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:1.0:1788574415.005302:0:17047:0:(genops.c:885:class_export_put()) final put ffff9c85fbbdf000/408a814b-bde8-48f8-9467-4baee1a765d4 00000001:00100000:1.0:1788574415.005307:0:17047:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 74bce780-6a9f-42e0-9637-fe6b1665ce5b 00000001:00080000:1.0:1788574415.005311:0:17047:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00000080:1.0:1788574415.005313:0:17047:0:(genops.c:885:class_export_put()) final put ffff9c85c6e7b800/74bce780-6a9f-42e0-9637-fe6b1665ce5b 00000020:00000080:0.0:1788574415.006072:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8600d39000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788574415.006224:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fbbdf000/408a814b-bde8-48f8-9467-4baee1a765d4 for lustre-MDT0000 00000020:00000080:0.0:1788574415.006259:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c6e7b800/74bce780-6a9f-42e0-9637-fe6b1665ce5b for lustre-MDT0000 00000020:00000080:0.0:1788574415.006281:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85ffb1c800 for lustre-MDT0000 00000020:00000080:0.0:1788574415.006286:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85fbbdb000 for lustre-MDT0000 00000020:00000080:0.0:1788574415.006291:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85c6e7d000 for lustre-MDT0000 00000001:00100000:2.0:1788574415.007581:0:19386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 74bce780-6a9f-42e0-9637-fe6b1665ce5b 00000020:00000080:2.0:1788574415.007589:0:19386:0:(genops.c:885:class_export_put()) final put ffff9c85c5f12800/74bce780-6a9f-42e0-9637-fe6b1665ce5b 00000020:00000080:0.0:1788574415.012206:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c44b1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788574415.012268:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c44b0000 for lustre-OST0001 00000020:00000080:3.0:1788574415.012703:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c5f12800/74bce780-6a9f-42e0-9637-fe6b1665ce5b for lustre-OST0001 00000020:00000080:3.0:1788574415.012747:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85c5f10800 for lustre-OST0001 00000001:00100000:0.0:1788574415.012840:0:17799:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788574415.012853:0:17799:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1788574415.012857:0:17799:0:(genops.c:885:class_export_put()) final put ffff9c85ffb14000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788574415.012876:0:17799:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 408a814b-bde8-48f8-9467-4baee1a765d4 00000001:00080000:0.0:1788574415.012881:0:17799:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1788574415.012884:0:17799:0:(genops.c:885:class_export_put()) final put ffff9c85fbbd9000/408a814b-bde8-48f8-9467-4baee1a765d4 00000001:00100000:0.0:1788574415.012889:0:17799:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 74bce780-6a9f-42e0-9637-fe6b1665ce5b 00000001:00080000:0.0:1788574415.012894:0:17799:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1788574415.012912:0:17799:0:(genops.c:885:class_export_put()) final put ffff9c85c6e7f000/74bce780-6a9f-42e0-9637-fe6b1665ce5b 00000020:00000080:1.0:1788574415.012978:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffb14000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788574415.013028:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fbbd9000/408a814b-bde8-48f8-9467-4baee1a765d4 for lustre-MDT0001 00000020:00000080:1.0:1788574415.013054:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c6e7f000/74bce780-6a9f-42e0-9637-fe6b1665ce5b for lustre-MDT0001 00000020:00000080:1.0:1788574415.013081:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85ffb17800 for lustre-MDT0001 00000020:00000080:1.0:1788574415.013085:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85fbbdd000 for lustre-MDT0001 00000020:00000080:1.0:1788574415.013097:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85fbbdf800 for lustre-MDT0001 00010000:00010000:0.0:1788574415.315425:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788574415.445150:0:20635:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c84c2499960 - data ffff9c85c9b93870/ffff9c85fbfd3400 00000020:01000000:3.0:1788574415.446232:0:20635:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c84c10bc0c0 - data ffff9c85dedd8360/ffff9c85fca64400 00000001:00000004:3.0:1788574415.458939:0:20635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00080000:2.0:1788574415.522134:0:20635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788574415.522146:0:20635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788574415.522162:0:20635:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c85f6676a00 x1875455681728256/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788574423 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574415.522208:0:20635:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788574415.533631:0:20635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788574415.533641:0:20635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1788574415.533661:0:20635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788574415.533665:0:20635:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788574415.534293:0:17091:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788574415.534299:0:17091:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788574415.534309:0:17091:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788574415.534804:0:20635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788574415.534810:0:20635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1788574415.534830:0:20635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788574415.534832:0:20635:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788574415.535318:0:17093:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788574415.535324:0:17093:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:1.0:1788574415.535333:0:17093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788574415.539667:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d040 00000020:00000080:0.0:1788574415.539681:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85f6f40800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788574415.540965:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85f6f40800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788574415.542496:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d055 00000020:00000080:0.0:1788574415.542510:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85f6f45800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788574415.542518:0:20635:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788574415.542525:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574415.542534:0:20635:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788574415.542539:0:20635:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9c84c2510000) has no exports 00000004:01000000:0.0:1788574415.542724:0:20635:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788574415.542734:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d0b7 00000020:00000080:0.0:1788574415.542739:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85e0bc7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788574415.542743:0:20635:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788574415.542746:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574415.542751:0:20635:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788574415.542753:0:20635:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9c84c270b380) has no exports 00000020:00000080:0.0:1788574415.542759:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d0b0 00000020:00000080:0.0:1788574415.542762:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85ffb64800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788574415.543172:0:20635:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788574415.543178:0:20635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788574415.543182:0:20635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1788574415.543208:0:20635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788574415.543211:0:20635:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788574415.543256:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574415.543263:0:20635:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788574415.543269:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d0a2 00000020:00000080:0.0:1788574415.543274:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85d20eb800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788574415.543278:0:20635:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788574415.543281:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574415.543285:0:20635:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788574415.543288:0:20635:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9c85faf499c0) has no exports 00000020:00000080:0.0:1788574415.543292:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d09b 00000020:00000080:0.0:1788574415.543296:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85d20eb000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788574415.543628:0:20635:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788574415.543632:0:20635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788574415.543634:0:20635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1788574415.543638:0:20635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788574415.543640:0:20635:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788574415.543664:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574415.543669:0:20635:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788574415.543679:0:20635:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788574415.543684:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d08d 00000020:00000080:0.0:1788574415.543689:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85d20ea800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788574415.543693:0:20635:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788574415.543696:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574415.543700:0:20635:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788574415.543702:0:20635:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9c84c2708000) has no exports 00000020:00000080:0.0:1788574415.543707:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d086 00000020:00000080:0.0:1788574415.543710:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85ffb65800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788574415.544824:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85f6f45800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788574415.544850:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85e0bc7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788574415.544856:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffb64800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788574415.544862:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c369e000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788574415.544869:0:8:0:(genops.c:885:class_export_put()) final put ffff9c85d20ef800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788574415.544872:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85d20ef800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788574415.544876:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788574415.545424:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85d20eb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788574415.545432:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85d20eb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788574415.545436:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85c4edd000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788574415.545442:0:8:0:(genops.c:885:class_export_put()) final put ffff9c85d20ee800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788574415.545444:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85d20ee800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788574415.545448:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788574415.545489:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85d20ea800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788574415.545494:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffb65800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788574415.551425:0:20635:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788574415.551434:0:20635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788574415.551438:0:20635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788574415.551447:0:20635:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788574415.551711:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574415.551725:0:20635:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788574415.551753:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574415.551756:0:20635:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788574415.551761:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85fa0fd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788574415.551766:0:20635:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fa0fd800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788574415.551785:0:20635:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788574415.551908:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d05c 00000020:00000080:1.0:1788574415.551927:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85f6f41000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788574415.552096:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85ffb61800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788574415.552106:0:8:0:(genops.c:885:class_export_put()) final put ffff9c85f6f46000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788574415.552109:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85f6f46000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788574415.552115:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788574415.552441:0:20635:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788574415.552447:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574415.552453:0:20635:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788574415.552457:0:20635:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9c84c2514d40) has no exports 00000020:00000080:1.0:1788574415.552478:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574415.552482:0:20635:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788574415.552486:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d063 00000020:00000080:1.0:1788574415.552491:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85f6f45000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788574415.552501:0:20635:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c84c3fd7800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788574415.552504:0:20635:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c84c3fd7800 3 00000020:01000004:1.0:1788574415.552507:0:20635:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c84c3fd7800 from lustre-MDT0000 00000020:00000080:1.0:1788574415.552524:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574415.552540:0:20635:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788574415.552543:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85f6f41800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788574415.552545:0:20635:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85f6f41800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788574415.552552:0:20635:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788574415.552589:0:20635:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788574415.552594:0:20635:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788574415.552597:0:20635:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788574415.552600:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574415.552603:0:20635:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788574415.552610:0:20635:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9c84c3eca000 f73678fb-d8c0-450f-a73b-e6565942045e 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788574415.552616:0:20635:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9c85faf4b380) has exports, disconnecting them 00000020:00080000:1.0:1788574415.552620:0:20635:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c84c3eca000), last request at 1788574320 00000020:00000080:1.0:1788574415.552635:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d008 00000020:00010000:1.0:1788574415.552639:0:20635:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c84c3eca000: total 2 00000100:00080000:1.0:1788574415.552643:0:20635:0:(import.c:65:import_set_state_nolock()) ffff9c84c3ece000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788574415.552660:0:20635:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c84c3eca000): rc 0 00000020:00080000:1.0:1788574415.552664:0:20635:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9c85faf4b380) has no exports 00000020:00010000:1.0:1788574415.552675:0:17055:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c84c3eca000: total 2 00010000:00010000:1.0:1788574415.552678:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574415.552703:0:17055:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c84c3eca000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788574415.552736:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32fe00/0x5bf8706fdac8d3c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d3c0 expref: 14 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574415.552752:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c84c2616600/0x5bf8706fdac8d269 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d262 expref: 13 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574415.552764:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152e200/0x5bf8706fdac8d3f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d3ea expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788574415.553125:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85f6f41000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788574415.553133:0:8:0:(genops.c:885:class_export_put()) final put ffff9c85f6f42800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788574415.553135:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85f6f42800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788574415.553140:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788574415.553183:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85f6f45000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1788574415.553290:0:17061:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c85fa297c00:17061] 1 exiting: rc = 0 00000100:00100000:2.0:1788574415.553861:0:17062:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c85de981c00:17062] 2 exiting: rc = 0 00000100:00100000:2.0:1788574415.554008:0:17060:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c84c225bc00:17060] 0 exiting: rc = 1 00000100:00100000:2.0:1788574415.554083:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554123:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554129:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554162:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554169:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554341:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554379:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554436:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554449:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554457:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554467:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554473:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554479:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554488:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554493:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554498:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554504:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554513:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554518:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554524:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554530:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554535:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554540:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554546:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554551:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554561:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554567:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554573:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554581:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554587:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554597:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554603:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554608:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554617:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554636:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554642:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554651:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554657:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554665:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554671:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554676:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554681:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554686:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554696:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554702:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554707:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554713:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554718:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554723:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554728:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554734:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554740:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554745:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554751:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554757:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554767:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554785:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554792:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554801:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554807:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554812:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554819:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554830:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574415.554839:0:20635:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1788574415.557610:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8d016 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d00f expref: 11 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574415.557668:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8d5b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d5aa expref: 10 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574415.557680:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32e800/0x5bf8706fdac8d127 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d120 expref: 9 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574415.557695:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c84c2616400/0x5bf8706fdac8d293 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d28c expref: 8 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574415.557708:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea3600/0x5bf8706fdac8d5bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d5b8 expref: 7 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574415.557718:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8d1e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d1dd expref: 6 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574415.557728:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32f600/0x5bf8706fdac8d135 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d12e expref: 5 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574415.557742:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32ee00/0x5bf8706fdac8d143 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d13c expref: 4 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574415.557753:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8d430 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d429 expref: 3 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574415.557766:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217fe00/0x5bf8706fdac8d5cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8d5c6 expref: 2 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574415.557780:0:17055:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c84c3eca000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788574415.557831:0:17055:0:(genops.c:885:class_export_put()) final put ffff9c84c3eca000/f73678fb-d8c0-450f-a73b-e6565942045e 00010000:00010000:1.0:1788574415.558051:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574415.558062:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574415.558065:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788574415.560206:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c3eca000/f73678fb-d8c0-450f-a73b-e6565942045e for MGS 00000020:00000080:2.0:1788574415.561329:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c3ece000 for MGS 00000020:01000000:2.0:1788574415.561830:0:20635:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c85d22e87e0 - data ffff9c85dedd3af8/ffff9c84c330c000 00000020:01000000:2.0:1788574415.562000:0:20635:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c84c3653660 - data ffff9c85deccc948/ffff9c85fa547000 00000020:00000080:2.0:1788574415.565651:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8cfec 00000020:00000080:2.0:1788574415.565665:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c84c4468000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788574415.565728:0:20635:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c84c3fd7800 from MGS, refs=2 00000020:01000004:2.0:1788574415.565732:0:20635:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c84c3fd7800 2 00000020:01000004:2.0:1788574415.565736:0:20635:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c84c3fd7800 from MGS 00000020:00000080:2.0:1788574415.565759:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788574415.565768:0:20635:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788574415.565771:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c84c446f000/MGS 00000020:00000080:2.0:1788574415.565774:0:20635:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c446f000/MGS for MGS 00000020:01000000:2.0:1788574415.565782:0:20635:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788574415.566055:0:20635:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788574415.566059:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574415.566269:0:20635:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788574415.566277:0:20635:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c85ffb60800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788574415.566283:0:20635:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9c85fa0bcd40) has exports, disconnecting them 00000020:00080000:2.0:1788574415.566289:0:20635:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c85ffb60800), last request at 1788574320 00000020:00000080:2.0:1788574415.566294:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d0ef 00000020:00080000:2.0:1788574415.566303:0:20635:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c85ffb60800): rc 0 00000020:00000080:2.0:1788574415.566307:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85ffb60800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788574415.566482:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c4468000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788574415.567056:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffb60800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788574415.570563:0:20635:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788574415.570573:0:20635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788574415.570577:0:20635:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788574415.570584:0:20635:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788574415.570727:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85e0bc2800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788574415.571014:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574415.571028:0:20635:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788574415.571034:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c85e0bc5000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788574415.571136:0:20635:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85e0bc5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788574415.571143:0:20635:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788574415.571248:0:20635:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c84c3fd7800 1 00000020:00000080:1.0:1788574415.571255:0:20635:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8cfde 00000020:00000080:1.0:1788574415.571262:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c84c446d800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788574415.571398:0:20635:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788574415.571408:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c446d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788574415.571418:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574415.571423:0:20635:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788574415.571426:0:20635:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9c84c27099c0) has no exports 00000020:00000080:1.0:1788574415.699168:0:20635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574415.699181:0:20635:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788574415.699557:0:20635:0:(genops.c:885:class_export_put()) final put ffff9c84c3fd7000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788574415.699564:0:20635:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c3fd7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788574415.699576:0:20635:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788574415.699697:0:20635:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c84c3fd6000 00000020:02000400:1.0:1788574415.699760:0:20635:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1788574416.019519:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681728768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574416.019617:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574416.019801:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681728768 00000100:00100000:2.0:1788574416.019811:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681728768 00000100:00100000:2.0:1788574416.019853:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788574416.019862:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875455681728768:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788574416.019870:0:17072:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788574416.019925:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875455681728768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (307us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788574416.019931:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:02020000:1.0:1788574416.020056:0:3617:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788574416.024988:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788574416.024996:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c8600d3f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788574416.025001:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788574416.031329:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c8600d3f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574416.031343:0:3617:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 473 00000100:00080000:1.0:1788574416.031354:0:3617:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c8600d3f800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574416.032168:0:3617:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85f6674000 x1875455681728896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788574416.032289:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681728896:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788574416.032356:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574416.032465:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681728896 00000100:00100000:2.0:1788574416.032488:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681728896 00000100:00100000:2.0:1788574416.032526:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788574416.032533:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3616:x1875455681728896:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788574416.032554:0:17807:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788574416.052024:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3616:x1875455681728896:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 19481us (19658us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788574416.052040:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788574416.053158:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c8600d3f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574416.053167:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788574416.053171:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681728896:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1788574416.339768:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574416.916404:0:17820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788574417.044621:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574417.044637:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681729024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574417.044728:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574417.044777:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681729024 00000100:00100000:2.0:1788574417.044784:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681729024 00000100:00100000:2.0:1788574417.044854:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788574417.044866:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6674700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681729024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788574417.044916:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788574417.044976:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6674700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681729024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574417.044984:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788574417.045007:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574417.045032:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574417.045038:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788574417.045042:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c8600d3f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574417.045048:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 556 00000100:00080000:1.0:1788574417.045053:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788574417.045059:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c8600d3f800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574417.045079:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c2335f80 x1875455681729280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574417.045128:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681729280:0@lo:38:kworker.0 00000100:00100000:2.0:1788574417.045169:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574417.045173:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681729664:0@lo:400:kworker.0 00000100:00100000:1.0:1788574417.045175:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681729152:0@lo:400:kworker.0 00000100:00100000:0.0:1788574417.045241:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574417.045249:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681729280 00000100:00100000:2.0:1788574417.045255:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681729280 00000100:00100000:0.0:1788574417.045274:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788574417.045284:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681729536:0@lo:400:kworker.0 00000100:00100000:2.0:1788574417.045286:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788574417.045295:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875455681729280:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788574417.045315:0:17072:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788574417.045335:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:1.0:1788574417.045343:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875455681729152 offset 0 length 224: 4 00000100:00100000:0.0:1788574417.045363:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875455681730048:0@lo:400:kworker.0 00000100:00100000:2.0:1788574417.045386:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875455681729280:12345-0@lo:38:kworker.0 Request processed in 89us (216us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788574417.045395:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574417.045399:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788574417.045424:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681729664 00000100:00100000:2.0:1788574417.045429:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681729664 00000100:00100000:0.0:1788574417.045442:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681729536 00000100:00100000:0.0:1788574417.045448:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681729536 00000100:00100000:2.0:1788574417.045458:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681730048 00000100:00100000:2.0:1788574417.045464:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681730048 00000100:00100000:0.0:1788574417.045479:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788574417.045480:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681729792:0@lo:400:kworker.0 00000100:00100000:0.0:1788574417.045487:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875455681729664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574417.045497:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788574417.045507:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875455681730048:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788574417.045515:0:17067:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788574417.045561:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875455681730048:12345-0@lo:400:kworker.0 Request processed in 55us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574417.045568:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875455681729664:12345-0@lo:400:kworker.0 Request processed in 79us (328us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788574417.045572:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788574417.045581:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574417.045586:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788574417.045590:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681729792 00000100:00100000:2.0:1788574417.045594:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681729792 00000100:00100000:1.0:1788574417.045610:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788574417.045613:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788574417.045622:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681729408:0@lo:400:kworker.0 00000100:00100000:0.0:1788574417.045622:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875455681729536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574417.045631:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000020:00080000:0.0:1788574417.045636:0:17067:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788574417.045642:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681729792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574417.045667:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574417.045674:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875455681729536:12345-0@lo:400:kworker.0 Request processed in 52us (338us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788574417.045682:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788574417.045691:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681729792:12345-0@lo:400:kworker.0 Request processed in 51us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574417.045700:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1788574417.045726:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788574417.045737:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681729024:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788574417.045751:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c8600d3f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574417.045758:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788574417.045764:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681729280:0@lo:38:kworker.0 00000100:00100000:1.0:1788574417.045769:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681729920:0@lo:400:kworker.0 00000100:00080000:0.0:1788574417.045786:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788574417.045790:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c85cbbe1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:1.0:1788574417.045796:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:02000400:0.0:1788574417.045796:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788574417.045803:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c85cbbe1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788574417.045809:0:3618:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 473 00000100:00080000:0.0:1788574417.045814:0:3618:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c85cbbe1800 using connection 192.168.204.151@tcp/0@lo 00010000:00080000:1.0:1788574417.045824:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9c84c2337b80 x1875455681729792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574417.045831:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681729920 00000100:00100000:1.0:1788574417.045834:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681729792:0@lo:400:kworker.0 00000100:00100000:0.0:1788574417.045834:0:3618:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85faf5f800 x1875455681730176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574417.045837:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681729920 00000100:00100000:0.0:1788574417.045864:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681729536:0@lo:400:kworker.0 00000100:00100000:1.0:1788574417.045869:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681729408 00000100:00100000:2.0:1788574417.045871:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788574417.045874:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681729408 00000100:00100000:2.0:1788574417.045880:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875455681729920:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788574417.045885:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9c85c8ab2300 x1875455681730048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574417.045907:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875455681730048:0@lo:400:kworker.0 00000020:00080000:2.0:1788574417.045920:0:17067:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:0.0:1788574417.045925:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788574417.045928:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c84c34c6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788574417.045932:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788574417.045935:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c84c34c6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788574417.045939:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788574417.045940:0:3618:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 488 00000100:00080000:0.0:1788574417.045948:0:3618:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c84c34c6800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574417.045953:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681729408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574417.045961:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875455681729920:12345-0@lo:400:kworker.0 Request processed in 80us (164us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788574417.045963:0:3618:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85faf5c000 x1875455681730304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574417.045977:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788574417.045982:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681729664:0@lo:400:kworker.0 00000100:00100000:1.0:1788574417.046000:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681729408:12345-0@lo:400:kworker.0 Request processed in 49us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574417.046007:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788574417.046013:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875455681730176:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788574417.046023:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681729408:0@lo:400:kworker.0 00000100:00080000:1.0:1788574417.046030:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788574417.046047:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788574417.046051:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c84c44b7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788574417.046054:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788574417.046058:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c84c44b7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574417.046061:0:3619:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 505 00000100:00080000:2.0:1788574417.046066:0:3619:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c84c44b7000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574417.046080:0:3619:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85f6674a80 x1875455681730432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574417.046092:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681729920:0@lo:400:kworker.0 00000100:00100000:0.0:1788574417.046229:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574417.046250:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875455681730304:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788574417.046276:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574417.046294:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875455681730432:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788574417.046321:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574417.046354:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681730176 00000100:00100000:0.0:1788574417.046358:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681730176 00000100:00100000:0.0:1788574417.046372:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681730304 00000100:00100000:0.0:1788574417.046383:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681730304 00000100:00100000:0.0:1788574417.046396:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681730432 00000100:00100000:0.0:1788574417.046398:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681730432 00000100:00100000:0.0:1788574417.046409:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788574417.046414:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875455681730176:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1788574417.046426:0:17068:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788574417.046461:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875455681730176:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 45us (232us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788574417.046467:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788574417.046480:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788574417.046484:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875455681730304:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1788574417.046493:0:17068:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788574417.046669:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875455681730304:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 183us (392us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788574417.046676:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788574417.046695:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788574417.046699:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875455681730432:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1788574417.046710:0:17068:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788574417.046740:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875455681730432:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 39us (418us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788574417.046746:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788574417.046782:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c44b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574417.046787:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788574417.046791:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875455681730432:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788574417.046804:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85cbbe1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574417.046814:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788574417.046818:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875455681730176:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1788574417.046836:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c34c6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574417.046840:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788574417.046843:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875455681730304:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1788574417.365216:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574418.388610:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788574418.606961:0:20836:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788574418.618451:0:20836:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788574418.618512:0:20836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d1e4 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.618527:0:20836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d1e4 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.618535:0:20836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d1e4 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.618542:0:20836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d1e4 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.618591:0:20836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788574418.618597:0:20836:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788574418.618680:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574418.618687:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d1e4 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574418.618694:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6e00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574418.618697:0:17055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d1e4 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574418.618705:0:17055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d1e4 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574418.618719:0:17055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d1e4 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574418.618724:0:17055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788574418.618727:0:17055:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788574418.618729:0:17055:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788574418.618770:0:17055:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d1e4 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574418.618777:0:17055:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574418.618808:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d1e4 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574418.618815:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d1e4 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574418.618828:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574418.618830:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574418.618832:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574418.618852:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f73678fb-d8c0-450f-a73b-e6565942045e:3618:1875455681730560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574418.618943:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574418.619021:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681730560 00000100:00100000:1.0:1788574418.619028:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681730560 00000100:00100000:1.0:1788574418.619064:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574418.619072:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3618:x1875455681730560:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788574418.619079:0:17052:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788574418 with bad export cookie 6627170477389959176 00000100:00080000:2.0:1788574418.619554:0:20836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574418.619559:0:20836:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788574418.619567:0:20836:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788574418.619573:0:20836:0:(import.c:65:import_set_state_nolock()) ffff9c85cbbe1800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788574418.619578:0:20836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574418.619580:0:20836:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788574418.619582:0:20836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788574418.620442:0:20836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d143 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.620457:0:20836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d143 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.620465:0:20836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d143 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.620471:0:20836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d143 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.620493:0:20836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574418.620499:0:20836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d430 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.620506:0:20836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d430 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.620530:0:20836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d430 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.620538:0:20836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d430 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.620551:0:20836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788574418.620558:0:20836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d5cd expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.620565:0:20836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d5cd expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.620571:0:20836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d5cd expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.620577:0:20836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d5cd expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.620585:0:20836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788574418.620589:0:20836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d135 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.620595:0:20836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d135 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.620601:0:20836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d135 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.620617:0:20836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d135 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574418.620625:0:20836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788574418.620628:0:20836:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788574418.620655:0:20836:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788574418.620659:0:20836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788574418.620663:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574418.620668:0:20836:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788574418.620675:0:20836:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9c84c44b4000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788574418.620681:0:20836:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9c85ec196800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788574418.620685:0:20836:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9c85f746cd40) has exports, disconnecting them 00000020:00080000:2.0:1788574418.620690:0:20836:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c84c44b4000), last request at 1788574417 00000020:00000080:2.0:1788574418.620696:0:20836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d41b 00000100:00080000:2.0:1788574418.620713:0:20836:0:(import.c:65:import_set_state_nolock()) ffff9c84c44b3000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788574418.620800:0:20836:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c84c44b4000): rc 0 00000020:00000080:2.0:1788574418.620803:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c84c44b4000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788574418.620814:0:20836:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c85ec196800), last request at 1788574417 00000020:00000080:2.0:1788574418.620818:0:20836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d2bd 00000100:00080000:2.0:1788574418.620823:0:20836:0:(import.c:65:import_set_state_nolock()) ffff9c85ec196000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788574418.620830:0:20836:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c85ec196800): rc 0 00000020:00000080:2.0:1788574418.620831:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c85ec196800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788574418.620838:0:20836:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb4d281ccbae0 00000100:00080000:2.0:1788574418.620879:0:20836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574418.620888:0:20836:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9c85f6676a00 x1875455681728768/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788574432 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574418.620902:0:20836:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788574418.621675:0:20836:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788574418.621682:0:20836:0:(import.c:65:import_set_state_nolock()) ffff9c8600d3f800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1788574418.627536:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788574418.627550:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d143 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627563:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617600 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574418.627568:0:17056:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d143 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627581:0:17056:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d143 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574418.627588:0:17056:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d143 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574418.627593:0:17056:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788574418.627596:0:17056:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1788574418.627599:0:17056:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1788574418.627664:0:17056:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d143 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627670:0:17056:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574418.627701:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d143 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627727:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d143 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627741:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788574418.627744:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d430 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627749:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616a00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574418.627753:0:17056:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d430 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627760:0:17056:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d430 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574418.627766:0:17056:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d430 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574418.627770:0:17056:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788574418.627772:0:17056:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788574418.627774:0:17056:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788574418.627788:0:17056:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d430 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627794:0:17056:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574418.627800:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d430 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627806:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d430 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627828:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574418.627832:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d5cd expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627838:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2c00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574418.627840:0:17056:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d5cd expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627846:0:17056:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d5cd expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574418.627852:0:17056:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d5cd expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574418.627871:0:17056:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788574418.627873:0:17056:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788574418.627875:0:17056:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788574418.627889:0:17056:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d5cd expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627905:0:17056:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574418.627918:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d5cd expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627924:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d5cd expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627932:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574418.627936:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d135 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627947:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616200 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574418.627950:0:17056:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d135 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627956:0:17056:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d135 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574418.627962:0:17056:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d135 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574418.627966:0:17056:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788574418.627968:0:17056:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788574418.627970:0:17056:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788574418.627989:0:17056:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d135 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.627994:0:17056:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574418.628000:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d135 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.628006:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8d135 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574418.628017:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574418.628019:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574418.628021:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788574418.628033:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c44b4000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788574418.628092:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ec196800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788574418.628116:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c44b3000 for lustre-MDT0001 00000020:00000080:0.0:1788574418.628127:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85ec196000 for lustre-MDT0001 00000100:00100000:0.0:1788574418.628777:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681730944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574418.628869:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574418.628984:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681728768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574418.629011:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574418.629017:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681731072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574418.629043:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574418.629069:0:17054:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788574418.629077:0:17054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788574418.629096:0:17053:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788574418.629103:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681730944 00000100:00100000:0.0:1788574418.629108:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681730944 00000100:00100000:0.0:1788574418.629133:0:17053:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788574418.629137:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681731072 00000100:00100000:0.0:1788574418.629139:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681731072 00010000:00010000:0.0:1788574418.629152:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574418.630081:0:20836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788574418.630087:0:20836:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788574418.630102:0:20836:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788574418.630236:0:20836:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788574418.630260:0:20836:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb1e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788574418.630274:0:20836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788574418.630276:0:20836:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000100:00100000:0.0:1788574418.631683:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681731200:0@lo:9:umount.0 00000100:00100000:0.0:1788574418.631771:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574418.634619:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681730816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574418.634701:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574418.634763:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574418.634770:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681730688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574418.634791:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574418.634826:0:17053:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788574418.634836:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681730816 00000100:00100000:0.0:1788574418.634843:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681730816 00000100:00100000:0.0:1788574418.634885:0:17053:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788574418.634891:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681730688 00000100:00100000:0.0:1788574418.634918:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681730688 00000004:00080000:2.0:1788574418.637705:0:20836:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788574418.639635:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681731200 00000100:00100000:1.0:1788574418.639650:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681731200 00000100:00100000:1.0:1788574418.639721:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788574418.639731:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875455681731200:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788574418.639760:0:18574:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d2e7 00000100:00080000:1.0:1788574418.639769:0:18574:0:(import.c:65:import_set_state_nolock()) ffff9c84c2214000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788574418.639812:0:18574:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788574418.640018:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3616:x1875455681731200:12345-0@lo:9:umount.0 Request processed in 287us (8245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574418.640026:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788574418.640767:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3618:x1875455681730560:12345-0@lo:103:ldlm_bl.0 Request processed in 21693us (21822us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788574418.640779:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574418.640802:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574418.640808:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3617:x1875455681730944:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788574418.640815:0:17052:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788574418 with bad export cookie 6627170477389959176 00000100:00100000:1.0:1788574418.640852:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3617:x1875455681730944:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (11996us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788574418.640871:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574418.640886:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788574418.640891:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3617:x1875455681731072:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788574418.640895:0:17052:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788574418 with bad export cookie 6627170477389959176 00000100:00100000:1.0:1788574418.640923:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3617:x1875455681731072:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (11878us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788574418.640928:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788574418.640969:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788574418.640973:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3620:x1875455681730816:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788574418.640978:0:17052:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788574418 with bad export cookie 6627170477389959176 00000100:00100000:1.0:1788574418.641020:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3620:x1875455681730816:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (6319us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788574418.641026:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788574418.641040:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574418.641044:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3620:x1875455681730688:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788574418.641048:0:17052:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788574418 with bad export cookie 6627170477389959176 00000100:00100000:1.0:1788574418.641074:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3620:x1875455681730688:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (6283us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788574418.641080:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788574418.641377:0:20836:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788574418.641402:0:20836:0:(import.c:65:import_set_state_nolock()) ffff9c84c2272000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788574418.641451:0:20836:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9c85f746cd40) has no exports 00000100:00100000:3.0:1788574418.641501:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681731328:0@lo:9:umount.0 00000100:00100000:3.0:1788574418.641542:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788574418.641599:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb1e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788574418.641612:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788574418.641615:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788574418.641618:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681731200:0@lo:9:umount.0 00010000:00010000:3.0:1788574418.641648:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574418.641660:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681731328 00000100:00100000:3.0:1788574418.641665:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681731328 00000100:00100000:3.0:1788574418.641697:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788574418.641703:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875455681731328:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788574418.641722:0:19093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d44c 00000100:00080000:3.0:1788574418.641729:0:19093:0:(import.c:65:import_set_state_nolock()) ffff9c85c6e7e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788574418.641763:0:19093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788574418.641893:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3616:x1875455681731328:12345-0@lo:9:umount.0 Request processed in 189us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574418.641900:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788574418.641933:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c2272000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788574418.641944:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788574418.641946:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788574418.641948:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681731328:0@lo:9:umount.0 00000100:00080000:3.0:1788574418.642001:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788574418.642005:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c84c446a000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788574418.642009:0:3617:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788574418.646817:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000001:00100000:1.0:1788574418.649854:0:18568:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788574418.649875:0:18568:0:(genops.c:885:class_export_put()) final put ffff9c84c2212800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788574418.650713:0:18568:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788574418.650719:0:18568:0:(genops.c:885:class_export_put()) final put ffff9c85c6e79000/lustre-MDT0000-mdtlov_UUID 00000100:00080000:3.0:1788574418.652038:0:3617:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.151@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788574418.652043:0:3617:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788574418.652053:0:3617:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c2334700 x1875455681729152/t0(0) o400->MGC192.168.204.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788574433 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574418.652081:0:3617:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c85c8ab3480 x1875455681730560/t0(0) o103->MGC192.168.204.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788574434 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574418.652111:0:3617:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c3724380 x1875455681730944/t0(0) o103->MGC192.168.204.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788574434 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574418.652120:0:3617:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c85faf5c000 x1875455681731072/t0(0) o103->MGC192.168.204.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788574434 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574418.652129:0:3617:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c3724000 x1875455681730816/t0(0) o103->MGC192.168.204.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788574434 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574418.652139:0:3617:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c3726a00 x1875455681730688/t0(0) o103->MGC192.168.204.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788574434 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788574418.652149:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788574418.652152:0:3617:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788574418.652154:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788574418.652226:0:3620:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c84c446a000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788574418.652265:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681729152:0@lo:400:kworker.0 00010000:00010000:0.0:1788574418.652342:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574418.652371:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681730816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574418.652386:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681730688:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788574418.652723:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c84c446a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574418.652729:0:3617:0:(import.c:545:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 460 00000100:00080000:3.0:1788574418.652738:0:3617:0:(import.c:665:import_select_connection()) MGC192.168.204.151@tcp: import ffff9c84c446a000 using connection 192.168.204.151@tcp/0@lo 00000020:00000080:3.0:1788574418.652749:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c2212800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788574418.652821:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c6e79000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788574418.652840:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c2214000 for lustre-OST0000 00000020:00000080:3.0:1788574418.652845:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85c6e78000 for lustre-OST0000 00000100:00100000:0.0:1788574418.655059:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f73678fb-d8c0-450f-a73b-e6565942045e:3618:1875455681730560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574418.655122:0:3617:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85fb9b6300 x1875455681731456/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574418.655154:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681730944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574418.655168:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681731072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574418.657671:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f73678fb-d8c0-450f-a73b-e6565942045e:3616:1875455681731456:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1788574418.657731:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875455681731456 offset 0 length 520: 4 00000020:00080000:1.0:1788574418.665578:0:20836:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9c85f746cd40) has no exports 00000020:01000000:2.0:1788574418.729105:0:20836:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c84c2499de0 - data ffff9c85deea4798/ffff9c85fbfd3000 00000020:01000000:2.0:1788574418.729296:0:20836:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c84c20740c0 - data ffff9c85dec3f510/ffff9c85c6538000 00000001:00000004:2.0:1788574418.740542:0:20836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1788574418.797869:0:20836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574418.797878:0:20836:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788574418.797886:0:20836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788574418.802627:0:20836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788574418.802636:0:20836:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788574418.802659:0:20836:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788574418.802662:0:20836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788574418.802998:0:17808:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788574418.803003:0:17808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1788574418.803015:0:17808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788574418.804110:0:20836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788574418.804117:0:20836:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788574418.804139:0:20836:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788574418.804141:0:20836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788574418.804974:0:17810:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788574418.804978:0:17810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1788574418.804988:0:17810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788574418.807056:0:20836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d151 00000020:00000080:2.0:1788574418.807069:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c85faf2d800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788574418.807559:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85faf2d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788574418.809095:0:20836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d166 00000020:00000080:2.0:1788574418.809108:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c85ffa63000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788574418.809319:0:20836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788574418.809326:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574418.809344:0:20836:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788574418.809349:0:20836:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9c85f746b380) has no exports 00000004:01000000:2.0:1788574418.809527:0:20836:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788574418.809536:0:20836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d1ba 00000020:00000080:2.0:1788574418.809540:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c85e0bce000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788574418.809768:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffa63000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788574418.809887:0:20836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788574418.809901:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574418.809907:0:20836:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788574418.809910:0:20836:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9c85fa0b8000) has no exports 00000020:00000080:2.0:1788574418.809917:0:20836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d1b3 00000020:00000080:2.0:1788574418.809922:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c84c2277000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788574418.809999:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85e0bce000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:2.0:1788574418.810965:0:20836:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788574418.810971:0:20836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788574418.810975:0:20836:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1788574418.810980:0:20836:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788574418.810983:0:20836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788574418.811103:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c2277000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788574418.811251:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788574418.811261:0:20836:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788574418.811268:0:20836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d1a5 00000020:00000080:2.0:1788574418.811274:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c85e0bcd000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788574418.813236:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c2272000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788574418.813255:0:470:0:(genops.c:885:class_export_put()) final put ffff9c85e0bcb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788574418.813258:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85e0bcb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788574418.813266:0:470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788574418.813640:0:20836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788574418.813663:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574418.813673:0:20836:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788574418.813678:0:20836:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9c84c303cd40) has no exports 00000020:00000080:2.0:1788574418.813685:0:20836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d19e 00000020:00000080:2.0:1788574418.813692:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c84c2276000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788574418.813716:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85e0bcd000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788574418.814240:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c2276000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788574418.814499:0:20836:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788574418.814503:0:20836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788574418.814507:0:20836:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1788574418.814513:0:20836:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788574418.814516:0:20836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788574418.814593:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788574418.814611:0:20836:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788574418.814626:0:20836:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788574418.814633:0:20836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d189 00000020:00000080:2.0:1788574418.814638:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c85fa1fb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788574418.814658:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85ffb1e800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788574418.814664:0:470:0:(genops.c:885:class_export_put()) final put ffff9c84c2277800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788574418.814672:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c2277800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788574418.814678:0:470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788574418.814778:0:20836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788574418.814782:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574418.814788:0:20836:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788574418.814791:0:20836:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9c84c25119c0) has no exports 00000020:00000080:2.0:1788574418.814800:0:20836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d182 00000020:00000080:2.0:1788574418.814817:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c8600d39800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788574418.814847:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fa1fb000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788574418.815960:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8600d39800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788574418.818265:0:20836:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788574418.818273:0:20836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788574418.818277:0:20836:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788574418.818285:0:20836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788574418.818338:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574418.818349:0:20836:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788574418.818386:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574418.818389:0:20836:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788574418.818404:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c85ffa66000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788574418.818408:0:20836:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffa66000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788574418.818415:0:20836:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788574418.818576:0:20836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d16d 00000020:00000080:0.0:1788574418.818584:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c85ffa67000/lustre-MDD0001_UUID 00000020:01000000:0.0:1788574418.818589:0:20836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788574418.818596:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574418.818602:0:20836:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788574418.818607:0:20836:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9c85f74699c0) has no exports 00000020:00000080:0.0:1788574418.818633:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574418.818636:0:20836:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788574418.818639:0:20836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d174 00000020:00000080:0.0:1788574418.818642:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c85ffa61000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788574418.818649:0:20836:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85c3688000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788574418.818652:0:20836:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85c3688000 2 00000020:01000004:0.0:1788574418.818654:0:20836:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c85c3688000 from lustre-MDT0001 00000020:00000080:0.0:1788574418.818734:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574418.818737:0:20836:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788574418.818740:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c85faf28800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788574418.818742:0:20836:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85faf28800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788574418.818748:0:20836:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788574418.818774:0:20836:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788574418.818778:0:20836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788574418.818780:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574418.818783:0:20836:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788574418.818789:0:20836:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9c85e0bc9000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788574418.818793:0:20836:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9c85fa0b99c0) has exports, disconnecting them 00000020:00080000:0.0:1788574418.818797:0:20836:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9c85e0bc9000), last request at 1788574333 00000020:00000080:0.0:1788574418.818801:0:20836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d1f2 00000020:00080000:0.0:1788574418.818814:0:20836:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c85e0bc9000): rc 0 00000020:00000080:0.0:1788574418.818822:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c85e0bc9000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788574418.819089:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c8600d3f800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788574418.819096:0:470:0:(genops.c:885:class_export_put()) final put ffff9c8600d3b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788574418.819098:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8600d3b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788574418.819104:0:470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788574418.819178:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffa67000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788574418.819181:0:470:0:(genops.c:885:class_export_put()) final put ffff9c85faf2f000/lustre-MDD0001_UUID 00000020:00000080:1.0:1788574418.819183:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85faf2f000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788574418.819186:0:470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788574418.819302:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffa61000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788574418.819309:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85e0bc9000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788574418.820226:0:20836:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788574418.820231:0:20836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788574418.820235:0:20836:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788574418.820241:0:20836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788574418.820260:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85cbbe1800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788574418.820407:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574418.820414:0:20836:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788574418.820418:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c85e0bcc800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788574418.820421:0:20836:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85e0bcc800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788574418.820424:0:20836:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788574418.820467:0:20836:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85c3688000 1 00000020:00000080:1.0:1788574418.820474:0:20836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d119 00000020:00000080:1.0:1788574418.820480:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c85c3689800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788574418.820487:0:20836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788574418.820502:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c3689800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788574418.820511:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574418.820515:0:20836:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788574418.820519:0:20836:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9c84c270cd40) has no exports 00000020:00000080:2.0:1788574418.876539:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788574418.876554:0:20836:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1788574418.876560:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c85c368a800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788574418.876565:0:20836:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c368a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788574418.876574:0:20836:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788574418.877678:0:20836:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c85c3688800 00000020:01000000:3.0:1788574418.877704:0:20836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788574418.877709:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788574418.877713:0:20836:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788574418.877717:0:20836:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9c85faf4cd40) has no exports 00000100:00100000:3.0:1788574418.877802:0:18898:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9c85d10f1000:18898] 3 exiting: rc = 0 00000100:00100000:3.0:1788574418.877924:0:17069:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9c85c3bda600:17069] 2 exiting: rc = 0 00000100:00100000:1.0:1788574418.878156:0:17068:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9c85c7507e00:17068] 1 exiting: rc = 0 00000100:00100000:0.0:1788574418.878368:0:17067:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9c85c7506400:17067] 0 exiting: rc = 1 00000100:00100000:3.0:1788574418.878593:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878612:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878619:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878625:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878633:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878639:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878646:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878652:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878660:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878665:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878672:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878678:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878685:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878691:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878698:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878750:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878757:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878763:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878769:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878775:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878781:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878786:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878792:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878797:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878802:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878807:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878813:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878818:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878823:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878828:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878833:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878838:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878844:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878866:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878873:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878879:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878893:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878899:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878904:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878910:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878916:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878922:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878929:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878934:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878942:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878947:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878953:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878959:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878964:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878970:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878976:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878981:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878988:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.878994:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.879000:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.879005:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.879010:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.879015:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.879020:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.879025:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.879030:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.879035:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.879041:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.879047:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.891607:0:17070:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c84c223de00:17070] 0 exiting: rc = 1 00000100:00100000:1.0:1788574418.892119:0:17071:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c84c2592400:17071] 1 exiting: rc = 0 00000100:00100000:3.0:1788574418.892254:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892270:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892277:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892284:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892290:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892296:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892300:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892323:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892329:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892335:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892341:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892347:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892352:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892357:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892363:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892368:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892373:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892378:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892383:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892387:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892393:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892399:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892405:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892410:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892416:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892421:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892426:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892442:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892448:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892453:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892458:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892463:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892468:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892473:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892478:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892483:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892488:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892502:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892511:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892518:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892528:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892534:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892548:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892558:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892564:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892569:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892575:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892581:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892587:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892593:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892599:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892604:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892609:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892614:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892620:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892625:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892629:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892635:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892640:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892645:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892650:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892660:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892666:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.892671:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.893752:0:17072:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9c85fa294600:17072] 0 exiting: rc = 1 00000100:00100000:0.0:1788574418.893785:0:17807:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9c85c3920400:17807] 2 exiting: rc = 0 00000100:00100000:3.0:1788574418.893874:0:17073:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9c85fa295600:17073] 1 exiting: rc = 0 00000100:00100000:0.0:1788574418.893980:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.893990:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.893996:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894003:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894009:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894014:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894021:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894028:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894036:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894043:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894049:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894067:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894074:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894080:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894087:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894093:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894745:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894757:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894763:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894770:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894777:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894782:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894792:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894816:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894824:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894830:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894837:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894844:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894863:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894870:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894877:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894899:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894905:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894913:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894918:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894938:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894946:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894952:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894958:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894963:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894970:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894975:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894981:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894987:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.894995:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895002:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895008:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895033:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895041:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895047:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895054:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895060:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895064:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895070:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895076:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895083:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895090:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895096:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895116:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895137:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895146:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895152:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895158:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.895173:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.923236:0:17075:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c85fa295c00:17075] 1 exiting: rc = 0 00000100:00100000:1.0:1788574418.923282:0:17074:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c85fa295e00:17074] 0 exiting: rc = 1 00000100:00100000:2.0:1788574418.925172:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925183:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925213:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925219:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925225:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925230:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925236:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925241:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925246:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925251:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925257:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925262:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925267:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925272:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925278:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925284:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925289:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925309:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925315:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925320:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925325:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925329:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925334:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925339:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925344:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925348:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925353:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925357:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925361:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925366:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925370:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925374:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925378:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925383:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925389:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925394:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925400:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925405:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925411:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925417:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925423:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925429:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925433:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925439:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925445:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925449:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925455:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925460:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925466:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925471:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925477:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925482:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925495:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925500:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925506:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925511:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925515:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925520:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925525:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925530:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925535:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925539:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925544:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.925549:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.926299:0:17077:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c85fa294000:17077] 1 exiting: rc = 0 00000100:00100000:3.0:1788574418.926790:0:17076:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c85fa294c00:17076] 0 exiting: rc = 1 00000100:00100000:2.0:1788574418.926868:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926876:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926883:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926888:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926893:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926898:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926903:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926908:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926913:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926920:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926926:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926931:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926938:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926944:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926950:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926955:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926960:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926965:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926971:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926976:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926981:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926987:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.926992:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927009:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927014:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927019:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927034:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927039:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927044:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927049:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927054:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927059:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927065:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927069:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927074:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927079:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927083:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927088:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927093:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927097:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927102:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927108:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927112:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927117:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927123:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927128:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927133:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927138:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927143:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927149:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927153:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927158:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927162:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927167:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927171:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927176:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927181:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927186:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927268:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927273:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927277:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927282:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927287:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.927292:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574418.927674:0:17079:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c85fa295400:17079] 1 exiting: rc = 0 00000100:00100000:1.0:1788574418.928821:0:17078:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c85fa294a00:17078] 0 exiting: rc = 1 00000100:00100000:2.0:1788574418.928966:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.928974:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.928980:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.928985:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.928991:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.928997:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929004:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929012:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929018:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929023:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929028:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929033:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929038:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929044:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929049:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929054:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929059:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929065:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929070:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929074:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929080:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929085:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929090:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929095:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929100:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929106:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929118:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929124:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929129:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929151:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929157:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929162:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929167:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929172:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929178:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929183:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929216:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929224:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929229:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929234:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929239:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929244:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929251:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929259:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929267:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929276:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929285:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929291:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929296:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929302:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929309:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929314:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929320:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929327:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929332:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929350:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929356:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929361:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929366:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929370:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929375:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929380:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929385:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.929390:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574418.930130:0:17080:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9c84c1bdee00:17080] 0 exiting: rc = 1 00000100:00100000:3.0:1788574418.930250:0:17081:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9c84c2592800:17081] 1 exiting: rc = 0 00000100:00100000:1.0:1788574418.930499:0:17082:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9c84c2593000:17082] 2 exiting: rc = 0 00000100:00100000:2.0:1788574418.930604:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930611:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930616:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930629:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930650:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930657:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930662:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930668:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930673:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930680:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930686:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930692:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930699:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930706:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930713:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930719:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930727:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930734:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930742:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930749:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930756:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930762:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930768:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930773:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930779:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930785:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930791:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930796:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930817:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930824:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930829:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930835:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930842:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.930847:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931136:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931152:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931158:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931163:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931169:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931174:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931179:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931185:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931223:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931231:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931238:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931244:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931249:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931255:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931261:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931267:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931273:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931279:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931301:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931308:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931314:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931321:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931326:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931331:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931346:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931353:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931358:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931363:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931369:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574418.931375:0:20836:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788574418.949687:0:20836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788574418.949701:0:20836:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788574418.949707:0:20836:0:(genops.c:885:class_export_put()) final put ffff9c84c4469800/MDS_uuid 00000020:00000080:2.0:1788574418.949712:0:20836:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c4469800/MDS_uuid for MDS 00000020:01000000:2.0:1788574418.949723:0:20836:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788574418.949883:0:20836:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788574419.411866:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574420.435597:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574421.459601:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788574422.164287:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) f73678fb-d8c0-450f-a73b-e6565942045e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574422.164297:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) f73678fb-d8c0-450f-a73b-e6565942045e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574422.164301:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574422.164304:0:470:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788574422.164308:0:470:0:(import.c:65:import_set_state_nolock()) ffff9c84c34c6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574422.164316:0:470:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 557 00000100:00080000:1.0:1788574422.164323:0:470:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788574422.164329:0:470:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c84c34c6800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574422.164373:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85c8ab2300 x1875455681731584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788574422.164427:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574422.164431:0:470:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788574422.164433:0:470:0:(import.c:65:import_set_state_nolock()) ffff9c84c44b7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574422.164436:0:470:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 557 00000100:00080000:1.0:1788574422.164439:0:470:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788574422.164442:0:470:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c84c44b7000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574422.164454:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85c8ab3800 x1875455681731840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574422.164595:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875455681731584:0@lo:38:kworker.0 00000400:00000100:2.0:1788574422.164648:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681731584 offset 0 length 520: 4 00000100:00100000:2.0:1788574422.164677:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875455681731840:0@lo:38:kworker.0 00000400:00000100:2.0:1788574422.164694:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681731840 offset 0 length 520: 4 00000100:00100000:0.0:1788574422.165495:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681731712:0@lo:400:kworker.0 00000400:00000100:0.0:1788574422.165525:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681731712 offset 0 length 224: 4 00000100:00100000:0.0:1788574422.165545:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574422.165551:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681731968:0@lo:400:kworker.0 00000400:00000100:0.0:1788574422.166143:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681731968 offset 0 length 224: 4 00010000:00010000:0.0:1788574422.484590:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788574422.526987:0:21037:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788574422.568918:0:21037:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788574422.568976:0:21037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d293 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574422.568992:0:21037:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d293 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574422.569000:0:21037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d293 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574422.569007:0:21037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d293 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574422.569092:0:21037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788574422.569100:0:21037:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788574422.569128:0:21037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788574422.569142:0:21037:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c85c8ab2300 x1875455681731584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788574437 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574422.569162:0:21037:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788574422.569168:0:21037:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788574422.569175:0:21037:0:(import.c:65:import_set_state_nolock()) ffff9c84c34c6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788574422.569180:0:21037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788574422.569183:0:21037:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c85c8ab2300 x1875455681731584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788574437 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574422.569209:0:21037:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788574422.569212:0:21037:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1788574422.569564:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875455681731584:0@lo:38:kworker.0 00000100:00080000:1.0:1788574422.573485:0:21037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788574422.573519:0:21037:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c85c8ab1c00 x1875455681731712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574438 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574422.573545:0:21037:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788574422.573551:0:21037:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788574422.573575:0:21037:0:(import.c:65:import_set_state_nolock()) ffff9c84c2217800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788574422.573961:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681731712:0@lo:400:kworker.0 00000100:00100000:2.0:1788574422.574864:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1875455681732096:0@lo:39:umount.0 00000400:00000100:2.0:1788574422.574923:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681732096 offset 0 length 224: 4 00010000:00010000:0.0:1788574422.575455:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574422.575466:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d293 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574422.575478:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616000 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574422.575482:0:17056:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d293 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574422.575493:0:17056:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d293 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574422.575500:0:17056:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d293 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574422.575506:0:17056:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788574422.575509:0:17056:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788574422.575512:0:17056:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788574422.575530:0:17056:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c84c446a000 00010000:00010000:0.0:1788574422.575534:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8d293 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574422.575541:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8d293 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574422.575730:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574422.575733:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574422.575735:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788574423.187577:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) f73678fb-d8c0-450f-a73b-e6565942045e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574423.187588:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) f73678fb-d8c0-450f-a73b-e6565942045e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574423.187591:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574423.187594:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788574423.187734:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681732224:0@lo:400:kworker.0 00000400:00000100:0.0:1788574423.187816:0:3617:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681732224 offset 0 length 224: 4 00010000:00010000:0.0:1788574423.507342:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788574424.222977:0:19386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788574424.222986:0:19386:0:(genops.c:885:class_export_put()) final put ffff9c85c6e7d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788574424.223215:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c6e7d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788574424.223271:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85c6e7e000 for lustre-OST0001 00010000:00010000:1.0:1788574424.531498:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574425.555926:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574426.579771:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574427.220775:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) f73678fb-d8c0-450f-a73b-e6565942045e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788574427.220787:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) f73678fb-d8c0-450f-a73b-e6565942045e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574427.220790:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788574427.220794:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788574427.220911:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574427.225340:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681732352:0@lo:400:kworker.0 00000400:00000100:3.0:1788574427.225432:0:3617:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681732352 offset 0 length 224: 4 00010000:00010000:0.0:1788574427.603425:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574428.628701:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574428.755797:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574418/real 1788574418] req@ffff9c85fb9b6300 x1875455681731456/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788574428 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574428.755844:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c85fb9b6300 x1875455681731456/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788574428 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574428.755866:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c446a000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574428.755891:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788574428.755896:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f73678fb-d8c0-450f-a73b-e6565942045e:3616:1875455681731456:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1788574428.756080:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) f73678fb-d8c0-450f-a73b-e6565942045e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574428.756085:0:470:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788574428.756088:0:470:0:(import.c:65:import_set_state_nolock()) ffff9c84c446a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574428.756094:0:470:0:(import.c:545:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 558 00000100:00080000:1.0:1788574428.756099:0:470:0:(import.c:630:import_select_connection()) MGC192.168.204.151@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788574428.756105:0:470:0:(import.c:665:import_select_connection()) MGC192.168.204.151@tcp: import ffff9c84c446a000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574428.756139:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85c8ab0a80 x1875455681732480/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788574428.756165:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574428.756183:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788574428.756359:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574428.756374:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681732608:0@lo:400:kworker.0 00000400:00000100:0.0:1788574428.756420:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681732608 offset 0 length 224: 4 00000100:00100000:2.0:1788574428.757147:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f73678fb-d8c0-450f-a73b-e6565942045e:3616:1875455681732480:0@lo:250:kworker.0 00000400:00000100:2.0:1788574428.757180:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875455681732480 offset 0 length 520: 4 00010000:00010000:0.0:1788574429.652391:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574430.676060:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574431.699670:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574432.723656:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574432.851355:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574422/real 1788574422] req@ffff9c85c8ab1880 x1875455681732096/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788574432 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574432.851388:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c85c8ab1880 x1875455681732096/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788574432 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574432.851407:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c2217800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788574432.851428:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1875455681732096:0@lo:39:umount.0 00000100:00080000:1.0:1788574432.851506:0:21037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788574432.851512:0:21037:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788574432.851518:0:21037:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788574432.854321:0:21037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d269 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574432.854346:0:21037:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d269 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574432.854353:0:21037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d269 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574432.854360:0:21037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d269 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574432.854434:0:21037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574432.854442:0:21037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d5bf expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574432.854449:0:21037:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d5bf expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574432.854454:0:21037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d5bf expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574432.854460:0:21037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d5bf expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574432.862286:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574432.862303:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d269 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574432.862315:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2a00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574432.862320:0:17055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d269 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574432.862330:0:17055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d269 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574432.862338:0:17055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d269 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574432.862344:0:17055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788574432.862347:0:17055:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788574432.862370:0:17055:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c84c446a000 00010000:00010000:0.0:1788574432.862391:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8d269 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574432.862399:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8d269 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574432.862419:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574432.862422:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d5bf expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574432.862428:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217fc00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574432.862431:0:17055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d5bf expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574432.862438:0:17055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d5bf expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574432.862445:0:17055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d5bf expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574432.862450:0:17055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788574432.862452:0:17055:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788574432.862458:0:17055:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c84c446a000 00010000:00010000:0.0:1788574432.862461:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8d5bf expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574432.862468:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574432.862469:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574432.862471:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574432.872265:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574432.872377:0:21037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788574432.872391:0:21037:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8d5bf expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574432.872423:0:21037:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788574432.872432:0:21037:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1788574432.872435:0:21037:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788574432.872470:0:21037:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788574432.872474:0:21037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788574432.872642:0:21037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574432.872650:0:21037:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788574432.872670:0:21037:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9c84c30399c0) has no exports 00000020:00080000:0.0:1788574432.872699:0:21037:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9c84c30399c0) has no exports 00000020:01000000:2.0:1788574432.876656:0:21037:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c85d20e5ea0 - data ffff9c85dee841b0/ffff9c85c5f9dc00 00000020:01000000:2.0:1788574432.876822:0:21037:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c84c33b04e0 - data ffff9c85c9b23bd0/ffff9c85f2379000 00100000:10000000:2.0:1788574432.890350:0:21037:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788574432.905618:0:21037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d277 00000020:00000080:3.0:1788574432.905630:0:21037:0:(genops.c:885:class_export_put()) final put ffff9c85ec197800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788574432.905706:0:21037:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85c8a34800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788574432.905710:0:21037:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85c8a34800 2 00000020:01000004:3.0:1788574432.905713:0:21037:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c85c8a34800 from lustre-OST0000 00000020:00000080:3.0:1788574432.905745:0:21037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788574432.905756:0:21037:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788574432.905758:0:21037:0:(genops.c:885:class_export_put()) final put ffff9c85ec194000/lustre-OST0000_UUID 00000020:00000080:3.0:1788574432.905762:0:21037:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ec194000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788574432.905768:0:21037:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788574432.905826:0:21037:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788574432.905830:0:21037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788574432.905834:0:21037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788574432.905839:0:21037:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788574432.905846:0:21037:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c84c34c2000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788574432.905852:0:21037:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9c84c2323380) has exports, disconnecting them 00000020:00080000:3.0:1788574432.905857:0:21037:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c84c34c2000), last request at 1788574348 00000020:00000080:3.0:1788574432.905860:0:21037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d2a1 00000020:00080000:3.0:1788574432.905868:0:21037:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c84c34c2000): rc 0 00000020:00000080:3.0:1788574432.905873:0:21037:0:(genops.c:885:class_export_put()) final put ffff9c84c34c2000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788574432.907522:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ec197800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788574432.915036:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c34c2000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788574432.915289:0:21037:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788574432.915295:0:21037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788574432.915299:0:21037:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788574432.915304:0:21037:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788574432.915477:0:21037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574432.915486:0:21037:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788574432.915492:0:21037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788574432.915496:0:21037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574432.915500:0:21037:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788574432.915507:0:21037:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9c84c2214800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788574432.915513:0:21037:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9c84c2324d40) has exports, disconnecting them 00000020:00080000:0.0:1788574432.915517:0:21037:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9c84c2214800), last request at 1788574348 00000020:00000080:0.0:1788574432.915522:0:21037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d2b6 00000020:00080000:0.0:1788574432.915535:0:21037:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c84c2214800): rc 0 00000020:00000080:0.0:1788574432.915540:0:21037:0:(genops.c:885:class_export_put()) final put ffff9c84c2214800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788574432.919068:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c34c6800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788574432.919084:0:36:0:(genops.c:885:class_export_put()) final put ffff9c84c34c3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788574432.919091:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c34c3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788574432.919100:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788574432.919942:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c2214800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788574432.919980:0:21037:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788574432.919985:0:21037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788574432.919990:0:21037:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788574432.919995:0:21037:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788574432.920019:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c2217800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788574432.922115:0:21037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574432.922128:0:21037:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788574432.922134:0:21037:0:(genops.c:885:class_export_put()) final put ffff9c84c34c1000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788574432.922138:0:21037:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c34c1000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788574432.922145:0:21037:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788574432.923026:0:21037:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85c8a34800 1 00000020:00000080:1.0:1788574432.923063:0:21037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d254 00000020:00000080:1.0:1788574432.923072:0:21037:0:(genops.c:885:class_export_put()) final put ffff9c85ffb14800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788574432.923082:0:21037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788574432.923098:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffb14800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788574432.923113:0:21037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574432.923243:0:21037:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788574432.923248:0:21037:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9c85e56999c0) has no exports 00000020:00000080:1.0:1788574433.048005:0:21037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574433.048019:0:21037:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788574433.048025:0:21037:0:(genops.c:885:class_export_put()) final put ffff9c85c8a34000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788574433.048030:0:21037:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c8a34000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788574433.048041:0:21037:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788574433.048159:0:21037:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c85c8a31000 00000020:02000400:1.0:1788574433.048911:0:21037:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788574433.747676:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574433.940846:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f73678fb-d8c0-450f-a73b-e6565942045e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788574433.940856:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f73678fb-d8c0-450f-a73b-e6565942045e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574433.940860:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788574433.940863:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788574433.940956:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574433.940976:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681732736:0@lo:400:kworker.0 00000400:00000100:1.0:1788574433.941040:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681732736 offset 0 length 224: 4 00010000:00010000:3.0:1788574434.773445:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574435.796298:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788574436.762517:0:21239:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788574436.774921:0:21239:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788574436.775007:0:21239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d3f1 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574436.776757:0:21239:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d3f1 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574436.776792:0:21239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d3f1 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574436.776799:0:21239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d3f1 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574436.776868:0:21239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788574436.776875:0:21239:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788574436.776918:0:21239:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788574436.776928:0:21239:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c85c8ab3800 x1875455681731840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788574437 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574436.776949:0:21239:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788574436.776955:0:21239:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788574436.776961:0:21239:0:(import.c:65:import_set_state_nolock()) ffff9c84c44b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788574436.776966:0:21239:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788574436.776970:0:21239:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c85c8ab3800 x1875455681731840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788574437 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574436.776977:0:21239:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788574436.776980:0:21239:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:2.0:1788574436.777078:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875455681731840:0@lo:38:kworker.0 00000100:00080000:3.0:1788574436.778036:0:21239:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788574436.778044:0:21239:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c85c8ab3100 x1875455681731968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574438 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574436.778111:0:21239:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c85c8ab3b80 x1875455681732224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574439 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574436.778130:0:21239:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c85f6674380 x1875455681732352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574443 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574436.778139:0:21239:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c85c8ab0380 x1875455681732608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574444 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574436.778158:0:21239:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c85f6677b80 x1875455681732736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574449 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574436.778164:0:21239:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788574436.778169:0:21239:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788574436.778216:0:21239:0:(import.c:65:import_set_state_nolock()) ffff9c85c6e78800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788574436.778255:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1875455681732864:0@lo:39:umount.0 00000400:00000100:3.0:1788574436.778301:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681732864 offset 0 length 224: 4 00000100:00100000:0.0:1788574436.778502:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681732352:0@lo:400:kworker.0 00000100:00100000:0.0:1788574436.778523:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681732224:0@lo:400:kworker.0 00000100:00100000:0.0:1788574436.778551:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681732608:0@lo:400:kworker.0 00010000:00010000:1.0:1788574436.778616:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574436.778625:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d3f1 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574436.778634:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2600 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574436.778638:0:17056:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d3f1 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574436.778648:0:17056:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d3f1 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574436.778665:0:17056:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d3f1 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574436.778683:0:17056:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788574436.778685:0:17056:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788574436.778688:0:17056:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788574436.778703:0:17056:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c84c446a000 00010000:00010000:1.0:1788574436.778707:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8d3f1 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574436.778713:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8d3f1 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574436.778728:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574436.778729:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574436.778731:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574436.778873:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681731968:0@lo:400:kworker.0 00000100:00100000:2.0:1788574436.778887:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681732736:0@lo:400:kworker.0 00010000:00010000:0.0:1788574436.820163:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574437.843429:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574438.867685:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788574439.059981:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) f73678fb-d8c0-450f-a73b-e6565942045e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788574439.059989:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) f73678fb-d8c0-450f-a73b-e6565942045e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788574439.892284:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574440.917960:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574441.941006:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574442.963347:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574443.924364:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574428/real 1788574428] req@ffff9c85c8ab0a80 x1875455681732480/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788574443 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574443.924408:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c85c8ab0a80 x1875455681732480/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788574443 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788574443.924428:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c446a000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788574443.924456:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788574443.924460:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f73678fb-d8c0-450f-a73b-e6565942045e:3616:1875455681732480:0@lo:250:kworker.0 00000100:00080000:1.0:1788574443.924517:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f73678fb-d8c0-450f-a73b-e6565942045e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574443.924522:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788574443.924525:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c84c446a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574443.924531:0:36:0:(import.c:545:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 568 00000100:00080000:1.0:1788574443.924536:0:36:0:(import.c:630:import_select_connection()) MGC192.168.204.151@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788574443.924542:0:36:0:(import.c:665:import_select_connection()) MGC192.168.204.151@tcp: import ffff9c84c446a000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574443.924572:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85c8ab0e00 x1875455681732992/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788574443.924635:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f73678fb-d8c0-450f-a73b-e6565942045e:3616:1875455681732992:0@lo:250:kworker.0 00000400:00000100:3.0:1788574443.924691:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875455681732992 offset 0 length 520: 4 00010000:00010000:1.0:1788574443.987594:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574445.011363:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574446.035467:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574446.995448:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574436/real 1788574436] req@ffff9c85fb9be680 x1875455681732864/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788574446 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574446.995498:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c85fb9be680 x1875455681732864/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788574446 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788574446.995555:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85c6e78800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788574446.995582:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1875455681732864:0@lo:39:umount.0 00000100:00080000:0.0:1788574446.996620:0:21239:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788574446.996645:0:21239:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788574446.996652:0:21239:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788574446.999876:0:21239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d3c7 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574446.999897:0:21239:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d3c7 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574446.999905:0:21239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d3c7 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574446.999911:0:21239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d3c7 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574446.999945:0:21239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574446.999953:0:21239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d5b1 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574446.999958:0:21239:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d5b1 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574446.999963:0:21239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d5b1 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574446.999968:0:21239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8d5b1 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574446.999989:0:21239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788574446.999994:0:21239:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788574447.000018:0:21239:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788574447.000022:0:21239:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788574447.000040:0:21239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574447.000046:0:21239:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788574447.000051:0:21239:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9c84c23219c0) has no exports 00000020:00080000:0.0:1788574447.000076:0:21239:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9c84c23219c0) has no exports 00010000:00010000:2.0:1788574447.000575:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574447.000584:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d3c7 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574447.000592:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152ea00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574447.000596:0:17055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d3c7 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574447.000617:0:17055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d3c7 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574447.000624:0:17055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d3c7 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574447.000629:0:17055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788574447.000631:0:17055:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788574447.000634:0:17055:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788574447.000650:0:17055:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c84c446a000 00010000:00010000:2.0:1788574447.000654:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8d3c7 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574447.000662:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8d3c7 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574447.000677:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574447.000681:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d5b1 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574447.000686:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3800 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574447.000689:0:17055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8d5b1 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574447.000695:0:17055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d5b1 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574447.000700:0:17055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d5b1 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574447.000715:0:17055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788574447.000717:0:17055:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788574447.000719:0:17055:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788574447.000724:0:17055:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c84c446a000 00010000:00010000:2.0:1788574447.000727:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8d5b1 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574447.000732:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8d5b1 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574447.000744:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574447.000746:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574447.000748:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574447.001295:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788574447.011750:0:21239:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c85d20e5420 - data ffff9c85d48e6798/ffff9c85fb9b2000 00000020:01000000:0.0:1788574447.011962:0:21239:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c85d22e8c00 - data ffff9c84c1d02d80/ffff9c84c3417400 00100000:10000000:0.0:1788574447.031999:0:21239:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788574447.046040:0:21239:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d3d5 00000020:00000080:3.0:1788574447.046053:0:21239:0:(genops.c:885:class_export_put()) final put ffff9c84c34c4800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788574447.046076:0:21239:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c84c2216000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788574447.046080:0:21239:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c84c2216000 2 00000020:01000004:3.0:1788574447.046083:0:21239:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c84c2216000 from lustre-OST0001 00000020:00000080:3.0:1788574447.046108:0:21239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788574447.046118:0:21239:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788574447.046121:0:21239:0:(genops.c:885:class_export_put()) final put ffff9c84c2213000/lustre-OST0001_UUID 00000020:00000080:3.0:1788574447.046124:0:21239:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c2213000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788574447.046131:0:21239:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788574447.046591:0:21239:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f73678fb-d8c0-450f-a73b-e6565942045e->MGS 00010000:00010000:3.0:1788574447.046609:0:21239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8d120 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d127 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574447.046621:0:21239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8d120 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d127 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574447.046627:0:21239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788574447.046630:0:21239:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788574447.046633:0:21239:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788574447.046646:0:21239:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c84c446a000 00010000:00010000:3.0:1788574447.046650:0:21239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8d120 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8d127 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574447.046666:0:21239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8d016 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574447.046687:0:21239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8d016 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574447.046692:0:21239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788574447.046695:0:21239:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788574447.046697:0:21239:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788574447.046707:0:21239:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c84c446a000 00010000:00010000:3.0:1788574447.046710:0:21239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8d016 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788574447.046726:0:21239:0:(import.c:65:import_set_state_nolock()) ffff9c84c446a000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788574447.046730:0:21239:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788574447.046732:0:21239:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788574447.046734:0:21239:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788574447.046738:0:21239:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788574447.046748:0:21239:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c85c8ab0e00 x1875455681732992/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788574463 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:2.0:1788574447.046840:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c34c4800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:3.0:1788574447.047254:0:21239:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788574447.047258:0:21239:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:0.0:1788574447.051620:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f73678fb-d8c0-450f-a73b-e6565942045e:3616:1875455681732992:0@lo:250:kworker.0 10000000:01000000:2.0:1788574447.052132:0:21239:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788574447.052148:0:21239:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8cffa 00000020:00000080:2.0:1788574447.052303:0:21239:0:(genops.c:885:class_export_put()) final put ffff9c84c446b800/f73678fb-d8c0-450f-a73b-e6565942045e 00000020:01000000:2.0:1788574447.052331:0:21239:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.151@tcp (flags='') 00000020:00000080:2.0:1788574447.052338:0:21239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574447.052355:0:21239:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.151@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788574447.052360:0:21239:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9c85faf48000) has no exports 00000020:00000080:3.0:1788574447.052478:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c446b800/f73678fb-d8c0-450f-a73b-e6565942045e for MGC192.168.204.151@tcp 10000000:01000000:0.0:1788574447.052663:0:17064:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788574447.052756:0:21239:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.151@tcp: client import never connected 00000100:00080000:2.0:1788574447.052760:0:21239:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788574447.052764:0:21239:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788574447.052767:0:21239:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788574447.052769:0:21239:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788574447.052821:0:21239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788574447.052828:0:21239:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.151@tcp (uuid f73678fb-d8c0-450f-a73b-e6565942045e) 00000020:01000000:2.0:1788574447.052835:0:21239:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788574447.052839:0:21239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574447.052868:0:21239:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788574447.052876:0:21239:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c84c2216800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788574447.052882:0:21239:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9c8600d5b380) has exports, disconnecting them 00000020:00080000:2.0:1788574447.052886:0:21239:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c84c2216800), last request at 1788574365 00000020:00000080:2.0:1788574447.052890:0:21239:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d3ff 00000020:00080000:2.0:1788574447.052904:0:21239:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c84c2216800): rc 0 00000020:00000080:2.0:1788574447.052908:0:21239:0:(genops.c:885:class_export_put()) final put ffff9c84c2216800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788574447.053524:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c446a000 for MGC192.168.204.151@tcp 00000020:00000080:3.0:1788574447.053534:0:470:0:(genops.c:885:class_export_put()) final put ffff9c84c446c800/f73678fb-d8c0-450f-a73b-e6565942045e 00000020:00000080:3.0:1788574447.053537:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c446c800/f73678fb-d8c0-450f-a73b-e6565942045e for MGC192.168.204.151@tcp 00000020:01000000:3.0:1788574447.053543:0:470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.151@tcp (f73678fb-d8c0-450f-a73b-e6565942045e) 00000020:00000080:3.0:1788574447.053839:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c2216800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788574447.055774:0:21239:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788574447.055782:0:21239:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788574447.055786:0:21239:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788574447.055806:0:21239:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788574447.055830:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c44b7000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788574447.056027:0:21239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788574447.056035:0:21239:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788574447.056040:0:21239:0:(genops.c:885:class_export_put()) final put ffff9c84c44b7800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788574447.056043:0:21239:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c44b7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788574447.056048:0:21239:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1788574447.056104:0:21239:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788574447.056107:0:21239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788574447.056112:0:21239:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788574447.056118:0:21239:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9c85c5f14800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788574447.056123:0:21239:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9c84c2320000) has exports, disconnecting them 00000020:00080000:3.0:1788574447.056128:0:21239:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9c85c5f14800), last request at 1788574365 00000020:00000080:3.0:1788574447.056131:0:21239:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d414 00000020:00080000:3.0:1788574447.056144:0:21239:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c85c5f14800): rc 0 00000020:00000080:3.0:1788574447.056148:0:21239:0:(genops.c:885:class_export_put()) final put ffff9c85c5f14800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788574447.056175:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c5f14800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788574447.059503:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:0.0:1788574447.071285:0:21239:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788574447.071296:0:21239:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788574447.071300:0:21239:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788574447.071317:0:21239:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788574447.071363:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85c6e78800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788574447.072475:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788574447.072629:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1788574447.072757:0:17050:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c85fa25b600:17050] 0 exiting: rc = 1 00000100:00100000:2.0:1788574447.073331:0:17051:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c85fa2a5e00:17051] 1 exiting: rc = 0 00000100:00100000:0.0:1788574447.073481:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.073490:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.073814:0:17054:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c85fa2a5800:17054] 2 exiting: rc = 0 00000100:00100000:0.0:1788574447.073907:0:17053:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c8601955800:17053] 1 exiting: rc = 0 00000100:00100000:0.0:1788574447.076554:0:17052:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c85fa2a4c00:17052] 0 exiting: rc = 1 00000100:00100000:0.0:1788574447.078468:0:20837:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c84c2404200:20837] 3 exiting: rc = 0 00000100:00100000:0.0:1788574447.078571:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078579:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078585:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078601:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078607:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078614:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078621:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078639:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078644:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078649:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078655:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078660:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078665:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078671:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078677:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078681:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078686:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078691:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078696:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078701:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078706:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078711:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078716:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078722:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078727:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078732:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078737:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078743:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078748:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078753:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078759:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078765:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078770:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078776:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078781:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078787:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078792:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078798:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078803:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078808:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078815:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078820:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078833:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078838:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078844:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078849:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.078855:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079077:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079090:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079095:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079101:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079106:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079112:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079117:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079123:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079128:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079562:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079577:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079582:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079587:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079592:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079597:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079601:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.079606:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788574447.082566:0:21239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574447.082580:0:21239:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1788574447.082587:0:21239:0:(genops.c:885:class_export_put()) final put ffff9c84c34c3800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1788574447.082591:0:21239:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c34c3800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1788574447.082598:0:21239:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1788574447.082653:0:21239:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c84c2216000 1 00000020:00000080:0.0:1788574447.082659:0:21239:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8d3b9 00000020:00000080:0.0:1788574447.082666:0:21239:0:(genops.c:885:class_export_put()) final put ffff9c85c5f16000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788574447.082680:0:21239:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788574447.082691:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c5f16000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788574447.082702:0:21239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574447.082786:0:21239:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788574447.082791:0:21239:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9c84c3038000) has no exports 00000020:00000080:0.0:1788574447.173172:0:21239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574447.173202:0:21239:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788574447.173209:0:21239:0:(genops.c:885:class_export_put()) final put ffff9c84c325c000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788574447.173213:0:21239:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c325c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788574447.173225:0:21239:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788574447.173578:0:21239:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c84c3258000 00000020:01000000:0.0:1788574447.173604:0:21239:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788574447.173608:0:21239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574447.173613:0:21239:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788574447.173618:0:21239:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9c85f7468000) has no exports 00000020:00000080:0.0:1788574447.175485:0:21239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574447.175762:0:21239:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788574447.175768:0:21239:0:(genops.c:885:class_export_put()) final put ffff9c85ffb10800/OSS_uuid 00000020:00000080:0.0:1788574447.176423:0:21239:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffb10800/OSS_uuid for OSS 00000020:01000000:0.0:1788574447.176432:0:21239:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788574447.176608:0:17063:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788574447.177027:0:18574:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9c84c34a8a00:18574] 2 exiting: rc = 0 00000100:00100000:3.0:1788574447.177073:0:19093:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9c84c2361800:19093] 3 exiting: rc = 0 00000100:00100000:2.0:1788574447.177119:0:18571:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9c85f6f59e00:18571] 0 exiting: rc = 1 00000100:00100000:3.0:1788574447.177212:0:18573:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9c85c7507400:18573] 1 exiting: rc = 0 00000100:00100000:0.0:1788574447.177297:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177316:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177323:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177329:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177334:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177340:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177346:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177351:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177357:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177362:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177367:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177372:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177380:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177386:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177391:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177396:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177401:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177417:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177434:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177440:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177445:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177454:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177461:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177472:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177478:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177483:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177488:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177493:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177508:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177514:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177519:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177524:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177529:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177536:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177541:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177547:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177553:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177558:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177564:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177570:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177575:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177581:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177591:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177597:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177603:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177609:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177614:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177620:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177626:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177631:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177645:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177652:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177665:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177670:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177677:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177683:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177688:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177693:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177699:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177704:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177709:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177714:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177719:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.177725:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574447.182557:0:18575:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c84c1bdce00:18575] 0 exiting: rc = 1 00000100:00100000:2.0:1788574447.182643:0:18576:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c84c1bdd600:18576] 1 exiting: rc = 0 00000100:00100000:0.0:1788574447.183122:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183131:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183141:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183148:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183154:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183160:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183165:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183171:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183176:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183181:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183204:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183214:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183220:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183228:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183234:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183240:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183245:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183251:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183256:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183261:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183266:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183271:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183276:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183293:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183300:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183318:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183327:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183335:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183345:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183351:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183358:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183363:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183369:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183375:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183380:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183385:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183390:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183395:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183400:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183405:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183411:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183417:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183423:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183429:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183436:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183448:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183457:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183463:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183469:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183475:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183481:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183487:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183493:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183784:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183793:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183799:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183805:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183811:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183824:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183831:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183841:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183848:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183858:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.183869:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574447.185666:0:18578:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c85cbf8e800:18578] 1 exiting: rc = 0 00000100:00100000:1.0:1788574447.187437:0:18579:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c85c67ab600:18579] 2 exiting: rc = 0 00000100:00100000:3.0:1788574447.188387:0:18577:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c84c1bdd400:18577] 0 exiting: rc = 1 00000100:00100000:1.0:1788574447.188884:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.188893:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.188909:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.188916:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.188933:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.188940:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.188946:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.188952:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.188958:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.188964:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.188970:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.188993:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189000:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189006:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189011:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189018:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189023:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189029:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189035:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189041:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189047:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189052:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189058:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189064:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189071:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189076:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189082:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189087:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189093:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189099:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189105:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189110:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189115:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189122:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189128:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189153:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189160:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189166:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189173:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189179:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189185:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189317:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189324:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189330:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189336:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189342:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189348:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189354:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189360:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189366:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189371:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189377:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189383:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189389:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189394:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189400:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189406:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189412:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189419:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189437:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189444:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189450:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189456:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.189468:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574447.194147:0:18580:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c85c67aa600:18580] 0 exiting: rc = 1 00000100:00100000:1.0:1788574447.194448:0:18581:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c85c67aa200:18581] 1 exiting: rc = 0 00000100:00100000:3.0:1788574447.194577:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194588:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194598:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194607:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194618:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194627:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194648:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194673:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194684:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194693:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194703:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194713:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194723:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194788:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194795:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194801:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194808:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194815:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194821:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194827:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194835:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194842:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194849:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194855:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194861:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194867:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194873:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194879:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194884:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194890:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194898:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194906:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194910:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194914:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194918:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194922:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194931:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194936:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194941:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194946:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194950:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194954:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194971:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194976:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194981:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194986:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194991:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.194997:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.195004:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.195021:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.195028:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.195034:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.195039:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.195050:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.195055:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.195061:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.195066:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.195071:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.195076:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.195080:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.195085:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.195090:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.195095:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574447.195105:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574447.196132:0:18582:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c84c4540c00:18582] 0 exiting: rc = 1 00000100:00100000:1.0:1788574447.196332:0:18583:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c8600cda800:18583] 1 exiting: rc = 0 00000100:00100000:1.0:1788574447.196397:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196424:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196436:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196444:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196458:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196477:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196500:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196508:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196515:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196522:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196530:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196536:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196542:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196549:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196555:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196561:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196568:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196575:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196594:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196601:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196607:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196613:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196620:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196627:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196633:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196639:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196646:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196652:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196658:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196664:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196683:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196690:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196697:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196847:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196866:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196874:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196883:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196891:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196898:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196910:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196918:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196924:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196944:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196951:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196958:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196964:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196971:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196977:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196984:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196991:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.196998:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.197006:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.197128:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.197136:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.197158:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.197165:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.197171:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.197178:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.197185:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.197346:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.197353:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.197360:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.197367:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574447.197381:0:21239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788574447.205655:0:21239:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788574471.668578:0:22006:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788574482.838867:0:22606:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788574482.838874:0:22606:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788574482.838875:0:22606:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788574482.838981:0:22606:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c84c2291800 00000020:01000004:0.0:1788574482.838996:0:22606:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788574482.839003:0:22606:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788574482.839017:0:22606:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c85fa0bb380) 00000020:00000080:0.0:1788574482.839031:0:22606:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788574482.908926:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788574482.910035:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788574482.915304:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788574482.915715:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788574482.916027:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788574482.916360:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788574482.917242:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788574482.917547:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788574482.918015:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788574482.919498:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788574482.919955:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788574482.920216:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788574482.920425:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788574482.920608:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788574482.924345:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788574482.924859:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788574482.926519:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788574482.927028:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788574482.927785:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788574482.928110:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788574482.929399:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788574482.930297:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788574482.930601:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788574482.930922:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788574482.931329:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788574482.931823:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788574482.932274:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788574482.934128:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788574482.936754:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788574482.937093:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788574482.937365:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788574482.937833:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788574482.938329:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788574482.939337:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788574482.939611:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788574482.944446:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788574482.947045:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788574482.947524:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788574482.947781:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788574482.948030:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788574482.949329:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788574482.949759:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788574482.949977:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788574482.950265:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788574482.950511:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788574482.950731:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788574482.952539:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788574482.958954:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788574482.959643:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788574482.960400:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788574482.962970:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788574482.963489:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788574482.964671:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:2.0:1788574482.965811:0:22606:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788574482.966032:0:22606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788574482.966040:0:22606:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788574482.966051:0:22606:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8d900 00000020:01000004:2.0:1788574482.967397:0:22606:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788574482.967403:0:22606:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788574482.967412:0:22606:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c84c2291800 from MGS 00000020:01000004:2.0:1788574482.967417:0:22606:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788574482.967442:0:22606:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c8600d5cd40) 00000020:00000080:2.0:1788574482.967459:0:22606:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788574482.967741:0:22606:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c84c2291800 from MGS, refs=2 00080000:01000000:2.0:1788574482.967748:0:22606:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788574482.967755:0:22606:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8d90e 00000100:00100000:2.0:1788574482.967874:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788574482.968007:0:22606:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788574482.968013:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788574482.969559:0:22606:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788574482.969570:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788574482.972888:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574482.973070:0:22606:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788574482.973077:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788574482.973705:0:22606:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788574482.973714:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788574482.977035:0:22606:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788574482.977049:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788574482.978040:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574482.978044:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574482.978046:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574482.978514:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574482.978517:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574482.978519:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574482.979046:0:22606:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788574482.985389:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788574482.985771:0:22606:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788574482.988581:0:22618:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788574482.988656:0:22606:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788574482.988694:0:22606:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788574482.989650:0:22606:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788574482.989954:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788574482.990361:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788574482.990369:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788574482.991608:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788574482.991631:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788574482.993255:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788574482.993266:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788574482.994268:0:22606:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788574482.994289:0:22606:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.151@tcp' 00000020:01000004:2.0:1788574482.994291:0:22606:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788574482.994319:0:22606:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.151@tcp (typ=mgc) 00000020:00000080:2.0:1788574482.994330:0:22606:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.151@tcp (ffff9c8600d599c0) 00000020:00000080:2.0:1788574482.994346:0:22606:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:0.0:1788574482.994840:0:22623:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:2.0:1788574482.994924:0:22606:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c84c446f800@MGC192.168.204.151@tcp: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1788574482.996261:0:22606:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.151@tcp-0 is initialized 00000040:01000000:0.0:1788574482.996338:0:22606:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788574482.996913:0:22624:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788574482.996988:0:22606:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.151@tcp (uuid 7a90d265-af03-4b80-95da-0de9cffed3f2) 00000020:00000080:0.0:1788574482.997009:0:22606:0:(genops.c:1385:class_connect()) connect: client 7a90d265-af03-4b80-95da-0de9cffed3f2, cookie 0x5bf8706fdac8d91c 00000100:00080000:0.0:1788574482.997021:0:22606:0:(import.c:545:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574482.997027:0:22606:0:(import.c:665:import_select_connection()) MGC192.168.204.151@tcp: import ffff9c84c446f800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574482.997128:0:22606:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85fb9b4700 x1875455681733120/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788574482.997150:0:22606:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7a90d265-af03-4b80-95da-0de9cffed3f2->MGS 00000020:01000004:0.0:1788574482.997184:0:22606:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788574482.997230:0:22606:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788574482.997243:0:22606:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c85fa0b99c0) 00000020:00000080:0.0:1788574482.997253:0:22606:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788574482.998888:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7a90d265-af03-4b80-95da-0de9cffed3f2:3616:1875455681733120:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788574482.998960:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574482.999072:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681733120 00000100:00100000:2.0:1788574482.999080:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681733120 00000100:00100000:2.0:1788574482.999113:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574482.999121:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3616:x1875455681733120:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788574482.999147:0:22619:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7a90d265-af03-4b80-95da-0de9cffed3f2@0@lo t0 exp 0000000000000000 cur 622 last 0 00000020:00000080:2.0:1788574482.999294:0:22619:0:(genops.c:1385:class_connect()) connect: client 7a90d265-af03-4b80-95da-0de9cffed3f2, cookie 0x5bf8706fdac8d92a 00000100:00080000:2.0:1788574482.999426:0:22619:0:(import.c:65:import_set_state_nolock()) ffff9c84c446d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574482.999482:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+5:3616:x1875455681733120:12345-0@lo:250:mount.lustre.0 Request processed in 360us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574482.999490:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574482.999537:0:3616:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788574482.999547:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.151@tcp: connect to target with instance 0 00000100:00080000:2.0:1788574482.999554:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788574482.999558:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788574482.999562:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c446f800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788574482.999564:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788574482.999572:0:3616:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788574482.999577:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7a90d265-af03-4b80-95da-0de9cffed3f2:3616:1875455681733120:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788574483.010040:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788574483.010488:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788574483.010496:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788574483.011884:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788574483.011896:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788574483.014180:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788574483.014225:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788574483.017009:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788574483.017421:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788574483.017429:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788574483.019882:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788574483.019897:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788574483.066060:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788574483.067033:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788574483.067041:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788574483.068757:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788574483.068771:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788574483.074934:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788574483.075504:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788574483.075513:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788574483.076691:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788574483.076703:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788574483.077489:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788574483.077668:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788574483.077673:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788574483.078319:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788574483.078327:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788574483.078918:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788574483.079060:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788574483.079064:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788574483.079864:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788574483.079872:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788574483.095742:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574483.095948:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788574483.095954:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788574483.097523:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788574483.097534:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788574483.098691:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788574483.098703:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788574483.099603:0:22606:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788574483.099643:0:22606:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788574483.099649:0:22606:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788574483.099756:0:22606:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788574483.099792:0:22606:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788574483.099796:0:22606:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788574483.099798:0:22606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788574483.099799:0:22606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574483.099800:0:22606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574483.099801:0:22606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574483.099802:0:22606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574483.099804:0:22606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788574483.099806:0:22606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788574483.099808:0:22606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574483.099809:0:22606:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788574483.099812:0:22606:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788574483.099819:0:22606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788574483.099820:0:22606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788574483.099821:0:22606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574483.099822:0:22606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574483.099823:0:22606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574483.099824:0:22606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574483.099825:0:22606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788574483.099826:0:22606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788574483.099827:0:22606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574483.099827:0:22606:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788574483.099854:0:22606:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788574483.099875:0:22606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681733248:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788574483.099949:0:22606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574483.100035:0:22606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574483.100096:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681733248 00000100:00100000:0.0:1788574483.100104:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681733248 00000100:00100000:0.0:1788574483.100387:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574483.100408:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+5:22606:x1875455681733248:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788574483.100457:0:22622:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788574483.100460:0:22622:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788574483.100463:0:22622:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788574483.100751:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788574483.101325:0:22622:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1788574483.102963:0:22644:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788574483.102971:0:22644:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788574483.102974:0:22644:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788574483.102976:0:22644:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788574483.103341:0:22644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788574483.105272:0:22622:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788574483.105301:0:22622:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788574483.107747:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+5:22606:x1875455681733248:12345-0@lo:253:mount.lustre.0 Request processed in 7340us (7786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574483.107769:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574483.107861:0:22606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681733248:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788574483.107877:0:22606:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788574483.107881:0:22606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788574483.107883:0:22606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788574483.107884:0:22606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574483.107885:0:22606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574483.107887:0:22606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574483.107888:0:22606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574483.107900:0:22606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788574483.107902:0:22606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788574483.107904:0:22606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574483.107905:0:22606:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788574483.107924:0:22606:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c84c2291800 from lustre-MDT0000 10000000:01000000:2.0:1788574483.107960:0:22606:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788574483.107963:0:22606:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788574483.107968:0:22606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c8600d599c0 10000000:01000000:2.0:1788574483.107972:0:22606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788574483.107980:0:22606:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c8600d599c0 from 1 10000000:01000000:2.0:1788574483.107983:0:22606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788574483.108023:0:22606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8d931 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.108034:0:22606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8d931 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.108045:0:22606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8d931 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574483.108065:0:22606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681733376:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788574483.108101:0:22606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574483.108229:0:22606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574483.108745:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681733376 00000100:00100000:1.0:1788574483.108762:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681733376 00000100:00100000:1.0:1788574483.108847:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574483.108856:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+5:22606:x1875455681733376:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574483.108870:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574483.108884:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d938 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d931 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574483.108911:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d931 expref: 6 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574483.108933:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d931 expref: 6 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574483.108941:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a3200, rc 0) 00000100:00100000:1.0:1788574483.108988:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+6:22606:x1875455681733376:12345-0@lo:101:mount.lustre.0 Request processed in 134us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574483.108995:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788574483.109071:0:22606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681733376:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574483.109086:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8d931 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d938 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574483.109094:0:22606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8d931 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d938 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574483.109176:0:22606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681733504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574483.109224:0:22606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574483.109537:0:22606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574483.109626:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681733504 00000100:00100000:2.0:1788574483.109632:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681733504 00000100:00100000:2.0:1788574483.109657:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574483.109664:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+6:22606:x1875455681733504:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574483.109751:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+6:22606:x1875455681733504:12345-0@lo:501:mount.lustre.0 Request processed in 87us (526us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788574483.109758:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574483.109837:0:22606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681733504:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788574483.109880:0:22606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788574483.109897:0:22606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8d931 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d938 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574483.109905:0:22606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8d931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d938 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574483.109913:0:22606:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c84c2291800 10000000:01000000:3.0:1788574483.109917:0:22606:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788574483.109921:0:22606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c84c2291800 10000000:01000000:3.0:1788574483.109924:0:22606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788574483.109927:0:22606:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c84c2291800 from 1 10000000:01000000:3.0:1788574483.109930:0:22606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788574483.109951:0:22606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8d93f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574483.109959:0:22606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8d93f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574483.109967:0:22606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8d93f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574483.109980:0:22606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681733632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788574483.110005:0:22606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574483.110017:0:22606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574483.110082:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681733632 00000100:00100000:2.0:1788574483.110092:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681733632 00000100:00100000:2.0:1788574483.110110:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574483.110127:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+6:22606:x1875455681733632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574483.110136:0:22619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574483.110147:0:22619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8d946 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d93f expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.110162:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8d946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d93f expref: 7 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.110180:0:22619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8d946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d93f expref: 7 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.110203:0:22619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217e000, rc 0) 00000100:00100000:2.0:1788574483.110379:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+7:22606:x1875455681733632:12345-0@lo:101:mount.lustre.0 Request processed in 252us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574483.110386:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788574483.110486:0:22606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681733632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574483.110497:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8d93f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d946 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574483.110517:0:22606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8d93f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d946 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574483.110528:0:22606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788574483.110542:0:22606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8d93f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d946 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574483.110549:0:22606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8d93f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d946 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574483.110556:0:22606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788574483.110559:0:22606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788574483.110562:0:22606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c84c2291800 10000000:01000000:3.0:1788574483.110565:0:22606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788574483.110567:0:22606:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788574483.110570:0:22606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788574483.110582:0:22606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2e00/0x5bf8706fdac8d94d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574483.110590:0:22606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea2e00/0x5bf8706fdac8d94d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574483.110598:0:22606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea2e00/0x5bf8706fdac8d94d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574483.110608:0:22606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681733760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788574483.110643:0:22606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574483.110662:0:22606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574483.110721:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681733760 00000100:00100000:2.0:1788574483.110725:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681733760 00000100:00100000:2.0:1788574483.110741:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788574483.110746:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+7:22606:x1875455681733760:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574483.110753:0:22619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574483.110761:0:22619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217fe00/0x5bf8706fdac8d954 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d94d expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.110774:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217fe00/0x5bf8706fdac8d954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d94d expref: 8 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.110782:0:22619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217fe00/0x5bf8706fdac8d954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d94d expref: 8 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.110794:0:22619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217fe00, rc 0) 00000100:00100000:2.0:1788574483.110826:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+8:22606:x1875455681733760:12345-0@lo:101:mount.lustre.0 Request processed in 79us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574483.110832:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574483.110961:0:22606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681733760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574483.110971:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea2e00/0x5bf8706fdac8d94d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d954 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574483.110979:0:22606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2e00/0x5bf8706fdac8d94d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d954 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574483.111020:0:22606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681733888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574483.111043:0:22606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574483.111061:0:22606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574483.111105:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681733888 00000100:00100000:2.0:1788574483.111109:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681733888 00000100:00100000:2.0:1788574483.111464:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788574483.111471:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+8:22606:x1875455681733888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574483.111582:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+9:22606:x1875455681733888:12345-0@lo:501:mount.lustre.0 Request processed in 111us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574483.111589:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574483.111723:0:22606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681733888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574483.111751:0:22606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681734016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574483.111787:0:22606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574483.113673:0:22606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788574483.113870:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681734016 00000100:00100000:1.0:1788574483.113880:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681734016 00000100:00100000:1.0:1788574483.113940:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788574483.113949:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+9:22606:x1875455681734016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574483.114853:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+9:22606:x1875455681734016:12345-0@lo:503:mount.lustre.0 Request processed in 901us (3060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574483.114864:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574483.114967:0:22606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681734016:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574483.115671:0:22645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a90d265-af03-4b80-95da-0de9cffed3f2:22645:1875455681734144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574483.115731:0:22645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574483.115773:0:22645:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8b88e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574483.115824:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681734144 00000100:00100000:0.0:1788574483.115830:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681734144 00000100:00100000:0.0:1788574483.115870:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788574483.115879:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+9:22645:x1875455681734144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574483.116818:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+9:22645:x1875455681734144:12345-0@lo:502:llog_process_th.0 Request processed in 937us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574483.116837:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788574483.117007:0:22645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a90d265-af03-4b80-95da-0de9cffed3f2:22645:1875455681734144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788574483.117047:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574483.117062:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.117064:0:22645:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788574483.117070:0:22645:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788574483.117073:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788574483.117089:0:22645:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c85e56999c0) 00000020:00000080:1.0:1788574483.117106:0:22645:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788574483.117261:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788574483.117471:0:22645:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788574483.117479:0:22645:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8d962 00000020:00000080:1.0:1788574483.117704:0:22645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788574483.117710:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574483.117714:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.117715:0:22645:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788574483.117718:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574483.117722:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.117723:0:22645:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788574483.117727:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788574483.117734:0:22645:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c85e569cd40) 00000020:00000080:1.0:1788574483.117745:0:22645:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788574483.117750:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788574483.117752:0:22645:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788574483.117754:0:22645:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788574483.117760:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788574483.117807:0:22645:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c84c2291800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788574483.117819:0:22645:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c85e569b380) 00000020:00000080:1.0:1788574483.117827:0:22645:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788574483.117886:0:22645:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788574483.117893:0:22645:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8d977 00000020:00000080:1.0:1788574483.117979:0:22645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788574483.117985:0:22645:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788574483.117989:0:22645:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5bf8706fdac8d97e 00080000:01000000:1.0:1788574483.117994:0:22645:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788574483.117997:0:22645:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8d985 00010000:00010000:3.0:1788574483.184013:0:22645:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788574483.184634:0:22645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934637 00000001:00080000:3.0:1788574483.184914:0:22645:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788574483.185648:0:22645:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c84c23219c0) 00000020:00000080:3.0:1788574483.185668:0:22645:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788574483.185751:0:22645:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788574483.185759:0:22645:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8d993 00000020:00000080:1.0:1788574483.186364:0:22645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788574483.188986:0:22645:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5bf8706fdac8d99a 00000020:00000080:1.0:1788574483.195913:0:22645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788574483.195929:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574483.195937:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.195939:0:22645:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788574483.195943:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788574483.195953:0:22645:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788574483.195955:0:22645:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788574483.195957:0:22645:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788574483.195959:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788574483.195962:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.195963:0:22645:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788574483.195966:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574483.195970:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.195971:0:22645:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788574483.195975:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788574483.196025:0:22645:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788574483.196040:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574483.196043:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.196045:0:22645:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788574483.196047:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574483.196050:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.196051:0:22645:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788574483.196054:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788574483.196059:0:22645:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:00000080:1.0:1788574483.196087:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788574483.196102:0:22645:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c85e5698000) 00000020:00000080:1.0:1788574483.196119:0:22645:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788574483.196124:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788574483.196179:0:22645:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788574483.196185:0:22645:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788574483.196220:0:22645:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8d9a8 00010000:00080000:1.0:1788574483.196252:0:22645:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85de98f800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1788574483.198977:0:22645:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788574483.200303:0:22645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788574483.200317:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788574483.200354:0:22645:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788574483.200374:0:22645:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8d9af 00000100:00080000:1.0:1788574483.200385:0:22645:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788574483.200408:0:22645:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c85de98f800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574483.200443:0:22645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85c8ab1180 x1875455681734272/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574483.200506:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681734272:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788574483.200580:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788574483.200653:0:22645:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788574483.200711:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574483.200715:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.200717:0:22645:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788574483.200720:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788574483.200723:0:22645:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1788574483.200725:0:22645:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788574483.200726:0:22645:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788574483.200728:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788574483.200730:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.200732:0:22645:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788574483.200734:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788574483.200738:0:22645:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788574483.200741:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.200743:0:22645:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788574483.200745:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788574483.200749:0:22645:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:1.0:1788574483.200771:0:22645:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788574483.200774:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788574483.200787:0:22645:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c84c25119c0) 00000020:00000080:1.0:1788574483.200800:0:22645:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788574483.200805:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788574483.200872:0:22645:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788574483.200878:0:22645:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788574483.200884:0:22645:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8d9bd 00010000:00080000:1.0:1788574483.200912:0:22645:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85d20ea800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1788574483.201134:0:22645:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1788574483.202039:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681734272 00000100:00100000:3.0:1788574483.202050:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681734272 00000100:00100000:3.0:1788574483.202086:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574483.202094:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875455681734272:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788574483.202122:0:22632:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1788574483.205089:0:22645:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788574483.206021:0:22645:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788574483.207854:0:22645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574483.208064:0:22645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788574483.218449:0:22645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1788574483.218846:0:22651:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788574483.218852:0:22651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788574483.219480:0:22645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788574483.219495:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788574483.219529:0:22645:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788574483.219552:0:22645:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8d9c4 00000100:00080000:2.0:1788574483.219562:0:22645:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788574483.219569:0:22645:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c85d20ea800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574483.219606:0:22645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85f6676680 x1875455681734400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574483.219676:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6676680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681734400:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788574483.219732:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681734400 offset 0 length 520: 4 00000100:00080000:2.0:1788574483.219791:0:22645:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788574483.219849:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574483.219853:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574483.219855:0:22645:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788574483.219858:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788574483.219866:0:22645:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788574483.219867:0:22645:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788574483.219869:0:22645:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788574483.219871:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788574483.219873:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574483.219875:0:22645:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788574483.219877:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788574483.219881:0:22645:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788574483.219884:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574483.219885:0:22645:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788574483.219888:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788574483.219892:0:22645:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:2.0:1788574483.219915:0:22645:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788574483.219917:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574483.219928:0:22645:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c8600d58000) 00000020:00000080:2.0:1788574483.219939:0:22645:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788574483.219943:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788574483.220002:0:22645:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788574483.220008:0:22645:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788574483.220014:0:22645:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8d9d2 00010000:00080000:2.0:1788574483.220045:0:22645:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85f6de8000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:2.0:1788574483.220271:0:22645:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788574483.220338:0:22645:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788574483.220353:0:22645:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788574483.222007:0:22645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574483.222381:0:22645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788574483.222527:0:22645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1788574483.222960:0:22653:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788574483.222964:0:22653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788574483.223802:0:22645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788574483.223827:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788574483.223862:0:22645:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788574483.223895:0:22645:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8d9d9 00000100:00080000:2.0:1788574483.223906:0:22645:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788574483.223919:0:22645:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c85f6de8000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574483.223984:0:22645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85f6676300 x1875455681734528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574483.224042:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681734528:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788574483.224100:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681734528 offset 0 length 520: 4 00000100:00080000:2.0:1788574483.224348:0:22645:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788574483.224414:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574483.224418:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574483.224420:0:22645:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788574483.224423:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574483.224427:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574483.224428:0:22645:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788574483.224431:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788574483.224433:0:22645:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788574483.224435:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574483.224437:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574483.224438:0:22645:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788574483.224440:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574483.224442:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574483.224443:0:22645:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788574483.224446:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788574483.224477:0:22645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a90d265-af03-4b80-95da-0de9cffed3f2:22645:1875455681734656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574483.224528:0:22645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574483.224556:0:22645:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c2568d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788574483.224686:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681734656 00000100:00100000:0.0:1788574483.224695:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681734656 00000100:00100000:0.0:1788574483.224775:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788574483.224784:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+9:22645:x1875455681734656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574483.224958:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+9:22645:x1875455681734656:12345-0@lo:502:llog_process_th.0 Request processed in 175us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574483.224966:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788574483.225043:0:22645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a90d265-af03-4b80-95da-0de9cffed3f2:22645:1875455681734656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788574483.225069:0:22645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574483.225074:0:22645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574483.225075:0:22645:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788574483.225079:0:22645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788574483.226750:0:22606:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788574483.226784:0:22606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788574483.226808:0:22606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2e00/0x5bf8706fdac8d94d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d954 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.226831:0:22606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea2e00/0x5bf8706fdac8d94d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d954 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574483.226840:0:22606:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c84c2291800 from 1 10000000:01000000:2.0:1788574483.226843:0:22606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788574483.226879:0:22606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217e200/0x5bf8706fdac8d9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.226888:0:22606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c860217e200/0x5bf8706fdac8d9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.226897:0:22606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c860217e200/0x5bf8706fdac8d9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574483.226919:0:22606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681734784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788574483.226975:0:22606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574483.227025:0:22606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c2568d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574483.227086:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681734784 00000100:00100000:1.0:1788574483.227094:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681734784 00000100:00100000:1.0:1788574483.227150:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574483.227158:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+9:22606:x1875455681734784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574483.227171:0:22619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574483.227184:0:22619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d08a2400/0x5bf8706fdac8d9e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d9e0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574483.227236:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d08a2400/0x5bf8706fdac8d9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d9e0 expref: 10 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574483.227246:0:22619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d08a2400/0x5bf8706fdac8d9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d9e0 expref: 10 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574483.227254:0:22619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a2400, rc 0) 00000100:00100000:1.0:1788574483.227292:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+10:22606:x1875455681734784:12345-0@lo:101:mount.lustre.0 Request processed in 135us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574483.227299:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574483.228328:0:22606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681734784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574483.228349:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c860217e200/0x5bf8706fdac8d9e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d9e7 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.228358:0:22606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c860217e200/0x5bf8706fdac8d9e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d9e7 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574483.228918:0:22606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681734912:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788574483.228974:0:22606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574483.229972:0:22606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c2568d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574483.230031:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681734912 00000100:00100000:1.0:1788574483.230038:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681734912 00000100:00100000:1.0:1788574483.230133:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574483.230143:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+10:22606:x1875455681734912:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788574483.231065:0:22622:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788574483.231085:0:22622:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788574483.231423:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+10:22606:x1875455681734912:12345-0@lo:256:mount.lustre.0 Request processed in 1279us (2446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574483.231433:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788574483.231500:0:22606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681734912:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788574483.232088:0:22606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788574483.232120:0:22606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217e200/0x5bf8706fdac8d9e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d9e7 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.232131:0:22606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860217e200/0x5bf8706fdac8d9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d9e7 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574483.232139:0:22606:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c84c2291800 from 1 10000000:01000000:2.0:1788574483.232142:0:22606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574483.232174:0:22606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217e400/0x5bf8706fdac8d9ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.232181:0:22606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c860217e400/0x5bf8706fdac8d9ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.232278:0:22606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c860217e400/0x5bf8706fdac8d9ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574483.232299:0:22606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681735040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788574483.232339:0:22606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574483.232371:0:22606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c2568d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574483.232391:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681735040 00000100:00100000:2.0:1788574483.232397:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681735040 00000100:00100000:2.0:1788574483.232451:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788574483.232459:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+10:22606:x1875455681735040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574483.232470:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574483.232483:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d9f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d9ee expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.232516:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d9f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d9ee expref: 11 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.232526:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d9f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d9ee expref: 11 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.232535:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217f200, rc 0) 00000100:00100000:2.0:1788574483.232566:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+11:22606:x1875455681735040:12345-0@lo:101:mount.lustre.0 Request processed in 108us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574483.232572:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788574483.232610:0:22606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681735040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574483.232698:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c860217e400/0x5bf8706fdac8d9ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d9f5 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.232707:0:22606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c860217e400/0x5bf8706fdac8d9ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d9f5 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574483.232761:0:22606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681735168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574483.232786:0:22606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574483.232799:0:22606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c2568d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574483.232812:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681735168 00000100:00100000:2.0:1788574483.232816:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681735168 00000100:00100000:2.0:1788574483.232834:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788574483.232839:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+11:22606:x1875455681735168:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574483.232964:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+11:22606:x1875455681735168:12345-0@lo:501:mount.lustre.0 Request processed in 125us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574483.232980:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788574483.233012:0:22606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681735168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574483.233039:0:22606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681735296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574483.233075:0:22606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574483.233089:0:22606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c2568d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574483.233101:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681735296 00000100:00100000:2.0:1788574483.233105:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681735296 00000100:00100000:2.0:1788574483.233253:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788574483.233260:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+11:22606:x1875455681735296:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574483.233336:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+11:22606:x1875455681735296:12345-0@lo:503:mount.lustre.0 Request processed in 76us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574483.233343:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788574483.233378:0:22606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681735296:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574483.233983:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a90d265-af03-4b80-95da-0de9cffed3f2:22655:1875455681735424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574483.234023:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574483.234090:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681735424 00000100:00100000:0.0:1788574483.234095:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681735424 00000100:00100000:1.0:1788574483.234106:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860183e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788574483.234185:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788574483.234230:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+11:22655:x1875455681735424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574483.234826:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+11:22655:x1875455681735424:12345-0@lo:502:llog_process_th.0 Request processed in 598us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574483.234834:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574483.234903:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a90d265-af03-4b80-95da-0de9cffed3f2:22655:1875455681735424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788574483.234930:0:22655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574483.234939:0:22655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.234941:0:22655:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788574483.234951:0:22655:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c84c2291800 00000020:00000080:1.0:1788574483.234954:0:22655:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574483.234962:0:22655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574483.234965:0:22655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.234966:0:22655:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788574483.234969:0:22655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574483.234971:0:22655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.234973:0:22655:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788574483.234976:0:22655:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c84c2291800 00000020:00000080:1.0:1788574483.234978:0:22655:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574483.235080:0:22655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574483.235084:0:22655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.235086:0:22655:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788574483.235089:0:22655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574483.235091:0:22655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.235093:0:22655:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788574483.235096:0:22655:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c84c2291800 00000020:00000080:1.0:1788574483.235103:0:22655:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574483.235131:0:22655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574483.235133:0:22655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.235140:0:22655:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788574483.235143:0:22655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574483.235145:0:22655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.235147:0:22655:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788574483.235150:0:22655:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c84c2291800 00000020:00000080:1.0:1788574483.235152:0:22655:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788574483.235210:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a90d265-af03-4b80-95da-0de9cffed3f2:22655:1875455681735552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574483.235250:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574483.235284:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8b88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574483.235333:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681735552 00000100:00100000:2.0:1788574483.235339:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681735552 00000100:00100000:2.0:1788574483.235371:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788574483.235379:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+11:22655:x1875455681735552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574483.235482:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+11:22655:x1875455681735552:12345-0@lo:502:llog_process_th.0 Request processed in 104us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574483.235489:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574483.235684:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a90d265-af03-4b80-95da-0de9cffed3f2:22655:1875455681735552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788574483.235703:0:22655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574483.235707:0:22655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574483.235708:0:22655:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788574483.235723:0:22655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788574483.239718:0:22606:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788574483.239764:0:22606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788574483.239787:0:22606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217e400/0x5bf8706fdac8d9ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d9f5 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.239814:0:22606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860217e400/0x5bf8706fdac8d9ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d9f5 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574483.239875:0:22606:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788574483.239879:0:22606:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c84c2291800 10000000:01000000:2.0:1788574483.239882:0:22606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c84c2291800 10000000:01000000:2.0:1788574483.239887:0:22606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788574483.239894:0:22606:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c84c2291800 from 1 10000000:01000000:2.0:1788574483.239897:0:22606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788574483.239936:0:22606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8d9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.239944:0:22606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8d9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.239956:0:22606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8d9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574483.239981:0:22606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681735680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788574483.240074:0:22606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574483.240119:0:22606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c2568840 going to sleep for 11 seconds 00000100:00100000:0.0:1788574483.243753:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681735680 00000100:00100000:0.0:1788574483.243765:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681735680 00000100:00100000:0.0:1788574483.243827:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574483.243839:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85cca03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+11:22606:x1875455681735680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574483.243864:0:22619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574483.243885:0:22619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d7e00/0x5bf8706fdac8da03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d9fc expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574483.243913:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d7e00/0x5bf8706fdac8da03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d9fc expref: 12 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574483.243926:0:22619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d7e00/0x5bf8706fdac8da03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d9fc expref: 12 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574483.243935:0:22619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7e00, rc 0) 00000100:00100000:0.0:1788574483.243987:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85cca03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+12:22606:x1875455681735680:12345-0@lo:101:mount.lustre.0 Request processed in 151us (3913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574483.244006:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788574483.245508:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875455681734272:12345-0@lo:38:llog_process_th.0 Request processed in 43407us (44921us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788574483.245526:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574483.245590:0:22606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681735680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574483.245626:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8d9fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8da03 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.245652:0:22606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8d9fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8da03 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574483.245738:0:22606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681735808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574483.245790:0:22606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574483.245829:0:22606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c2568840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574483.245849:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681735808 00000100:00100000:2.0:1788574483.245855:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681735808 00000100:00100000:2.0:1788574483.245906:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788574483.245915:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85cca03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+12:22606:x1875455681735808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574483.246051:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85cca03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+12:22606:x1875455681735808:12345-0@lo:501:mount.lustre.0 Request processed in 138us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574483.246071:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788574483.246111:0:22606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681735808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574483.246138:0:22606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681735936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574483.246180:0:22606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574483.246228:0:22606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c2568840 going to sleep for 11 seconds 00000100:00080000:0.0:1788574483.248215:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85de98f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574483.248225:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788574483.248230:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681734272:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788574483.248271:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681735936 00000100:00100000:0.0:1788574483.248277:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681735936 00000100:00100000:0.0:1788574483.248330:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788574483.248341:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+12:22606:x1875455681735936:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574483.248556:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+12:22606:x1875455681735936:12345-0@lo:503:mount.lustre.0 Request processed in 216us (2373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574483.248652:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788574483.249602:0:22606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681735936:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574483.250030:0:22660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a90d265-af03-4b80-95da-0de9cffed3f2:22660:1875455681736064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574483.250090:0:22660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574483.250283:0:22660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa319a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574483.250320:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681736064 00000100:00100000:2.0:1788574483.250327:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681736064 00000100:00100000:2.0:1788574483.250371:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788574483.250380:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+12:22660:x1875455681736064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574483.250537:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+12:22660:x1875455681736064:12345-0@lo:502:llog_process_th.0 Request processed in 156us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574483.250555:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788574483.250634:0:22660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a90d265-af03-4b80-95da-0de9cffed3f2:22660:1875455681736064:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788574483.250696:0:22660:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788574483.250714:0:22660:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c84c2514d40) 00000020:00000080:1.0:1788574483.250735:0:22660:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788574483.250859:0:22660:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c84c2291800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788574483.250864:0:22660:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c84c2291800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788574483.250867:0:22660:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c84c2291800 4 00010000:00080000:1.0:1788574483.250894:0:22660:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85c6588800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1788574483.253181:0:22660:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788574483.254725:0:22660:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788574483.254819:0:22660:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788574483.254839:0:22660:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5bf8706fdac8da11 00000100:00080000:1.0:1788574483.254850:0:22660:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788574483.254857:0:22660:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c85c6588800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574483.254892:0:22660:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85c8ab0700 x1875455681736192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574483.254933:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875455681736192:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788574483.254998:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788574483.255056:0:22660:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788574483.255086:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681736192 00000100:00100000:3.0:1788574483.255094:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681736192 00000100:00100000:3.0:1788574483.255130:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574483.255137:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875455681736192:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788574483.255216:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875455681736192:12345-0@lo:38:llog_process_th.0 Request processed in 77us (217us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788574483.255224:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574483.255274:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788574483.255282:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85c6588800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788574483.255286:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788574483.255290:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875455681736192:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788574483.256006:0:22660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a90d265-af03-4b80-95da-0de9cffed3f2:22660:1875455681736320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574483.256060:0:22660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574483.256096:0:22660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa319600 going to sleep for 11 seconds 00000100:00100000:2.0:1788574483.257124:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681736320 00000100:00100000:2.0:1788574483.257132:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681736320 00000100:00100000:2.0:1788574483.257175:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574483.257184:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+12:22660:x1875455681736320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574483.258133:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+12:22660:x1875455681736320:12345-0@lo:502:llog_process_th.0 Request processed in 947us (2071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574483.258144:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788574483.258297:0:22660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a90d265-af03-4b80-95da-0de9cffed3f2:22660:1875455681736320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574483.258359:0:22660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a90d265-af03-4b80-95da-0de9cffed3f2:22660:1875455681736448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574483.258411:0:22660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574483.258484:0:22660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa319600 going to sleep for 11 seconds 00000100:00100000:2.0:1788574483.258520:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681736448 00000100:00100000:2.0:1788574483.258526:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681736448 00000100:00100000:2.0:1788574483.258555:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788574483.258562:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+12:22660:x1875455681736448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574483.258909:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+12:22660:x1875455681736448:12345-0@lo:502:llog_process_th.0 Request processed in 346us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574483.258917:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788574483.258978:0:22660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a90d265-af03-4b80-95da-0de9cffed3f2:22660:1875455681736448:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788574483.259131:0:22660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788574483.259391:0:22606:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788574483.259418:0:22606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788574483.259437:0:22606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8d9fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8da03 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.259448:0:22606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8d9fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8da03 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788574483.259499:0:22606:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788574483.259501:0:22606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788574483.259502:0:22606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574483.259503:0:22606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574483.259508:0:22606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574483.259509:0:22606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574483.259510:0:22606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788574483.259511:0:22606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788574483.259513:0:22606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574483.259514:0:22606:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788574483.259518:0:22606:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788574483.259520:0:22606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788574483.259543:0:22606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788574483.259544:0:22606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574483.259545:0:22606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574483.259546:0:22606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574483.259547:0:22606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574483.259548:0:22606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788574483.259549:0:22606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788574483.259550:0:22606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574483.259551:0:22606:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788574483.259569:0:22606:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788574483.259582:0:22606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681736576:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788574483.259848:0:22606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574483.259938:0:22606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c2568600 going to sleep for 11 seconds 00000100:00100000:2.0:1788574483.259990:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681736576 00000100:00100000:2.0:1788574483.260064:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681736576 00000100:00100000:2.0:1788574483.260098:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788574483.260105:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+12:22606:x1875455681736576:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788574483.260126:0:22619:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788574483.260138:0:22619:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788574483.265351:0:22619:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788574483.265368:0:22619:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788574483.265386:0:22643:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788574483.265392:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788574483.265435:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8da18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574483.265476:0:22643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d08a2400/0x5bf8706fdac8d9e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d9e0 expref: 12 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574483.265485:0:22643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8da18 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574483.265573:0:22643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d08a2400/0x5bf8706fdac8d9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8d9e0 expref: 12 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574483.265588:0:22643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85d08a2400/0x5bf8706fdac8d9e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8d9e0 expref: 12 pid: 22619 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574483.265644:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22643:1875455681736704:0@lo:104: 00000100:00100000:0.0:1788574483.266023:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574483.266081:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574483.266169:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681736704 00000100:00100000:3.0:1788574483.266177:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681736704 00000100:00100000:3.0:1788574483.266245:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574483.266254:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+3:22643:x1875455681736704:12345-0@lo:104: 00010000:00010000:3.0:1788574483.266268:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c860217e200/0x5bf8706fdac8d9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d9e7 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574483.266326:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574483.266333:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+3:22643:x1875455681736704:12345-0@lo:104: Request processed in 81us (311us total) trans 0 rc 0/0 00010000:00010000:2.0:1788574483.266337:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788574483.266339:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22643:1875455681736704:0@lo:104: 00000100:00100000:3.0:1788574483.266342:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788574483.266348:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860217e200/0x5bf8706fdac8d9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d9e7 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.266359:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217e200 already unused, calling callback (ffffffffc1472c20) 00010000:00010000:0.0:1788574483.266361:0:22643:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8da18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574483.266364:0:22616:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860217e200/0x5bf8706fdac8d9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8d9e7 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.266380:0:22616:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860217e200/0x5bf8706fdac8d9e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8d9e7 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574483.266387:0:22616:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860217e200/0x5bf8706fdac8d9e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8d9e7 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574483.266393:0:22616:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574483.266433:0:22616:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c860217e200/0x5bf8706fdac8d9e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d9e7 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.266440:0:22616:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574483.266465:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860217e200/0x5bf8706fdac8d9e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d9e7 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.266472:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860217e200/0x5bf8706fdac8d9e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d9e7 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.266489:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574483.266491:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574483.266493:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574483.266501:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a90d265-af03-4b80-95da-0de9cffed3f2:3617:1875455681736832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574483.266881:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574483.267354:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681736832 00000100:00100000:2.0:1788574483.267360:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681736832 00010000:00010000:2.0:1788574483.267383:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d08a2400/0x5bf8706fdac8d9e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d9e0 expref: 13 pid: 22619 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574483.267570:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+13:22606:x1875455681736576:12345-0@lo:253:mount.lustre.0 Request processed in 7463us (7735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574483.267581:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788574483.268302:0:22606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:22606:1875455681736576:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788574483.268326:0:22606:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788574483.268329:0:22606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788574483.268330:0:22606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788574483.268331:0:22606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574483.268332:0:22606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574483.268333:0:22606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574483.268334:0:22606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574483.268335:0:22606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788574483.268336:0:22606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788574483.268337:0:22606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574483.268338:0:22606:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788574483.268350:0:22606:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788574483.270659:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574483.270682:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+12:3617:x1875455681736832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574483.270704:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574483.270714:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d08a2400/0x5bf8706fdac8d9e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d9e0 expref: 12 pid: 22619 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.270748:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d08a2400/0x5bf8706fdac8d9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8d9e0 expref: 12 pid: 22619 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.270767:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d08a2400/0x5bf8706fdac8d9e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8d9e0 expref: 12 pid: 22619 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.270781:0:22612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8da18 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.270790:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8da18 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788574483.270817:0:22612:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005426108s 00010000:00010000:2.0:1788574483.270823:0:22612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8da18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.270829:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8da18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.270836:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8da18 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.270843:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8da18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.270849:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574483.270854:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8da18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.270861:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8da18 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.270893:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8da18 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574483.270904:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574483.270976:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+11:3617:x1875455681736832:12345-0@lo:103:ldlm_bl.0 Request processed in 304us (4095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574483.270984:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574483.271041:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a90d265-af03-4b80-95da-0de9cffed3f2:3617:1875455681736832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574483.271397:0:22643:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8da18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574483.271407:0:22643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8da18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574483.271413:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8da18 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788574483.285646:0:22606:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:2.0:1788574483.286074:0:22606:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788574483.287628:0:22667:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788574483.287650:0:22606:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1788574483.288507:0:22667:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788574483.289177:0:22666:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:0.0:1788574483.289424:0:22666:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000100:00080000:0.0:1788574483.289979:0:22668:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9c85fb9b6d80 x1875455681736960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574483.289992:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00000040:01000000:2.0:1788574483.290574:0:22606:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788574483.290628:0:22606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788574483.291944:0:22606:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788574483.291960:0:22606:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788574483.292023:0:22606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574483.294023:0:22606:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788574483.294562:0:22667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788574483.294633:0:22667:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1788574483.295917:0:22606:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788574483.295971:0:22606:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788574483.297004:0:22606:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1788574483.298084:0:22606:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1788574483.300736:0:22606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788574483.304180:0:22606:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788574483.304413:0:22606:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4d2815b7988 00100000:10000000:2.0:1788574483.304425:0:22606:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788574483.305106:0:22606:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788574483.305124:0:22606:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788574483.305144:0:22606:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788574483.305173:0:22606:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788574483.309800:0:22606:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788574483.310016:0:22606:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788574483.987684:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574484.307392:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00000040:00080000:1.0:1788574484.308359:0:22662:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788574484.308376:0:22662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788574484.309701:0:22662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788574484.309710:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:3.0:1788574484.435369:0:22624:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788574484.435379:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c84c2291800 from 11 10000000:01000000:3.0:1788574484.435384:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788574484.435434:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8da1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574484.435446:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8da1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574484.435457:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8da1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574484.435484:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681737088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574484.435566:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574484.435629:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574484.435869:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681737088 00000100:00100000:2.0:1788574484.435877:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681737088 00000100:00100000:2.0:1788574484.435931:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788574484.435940:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+11:22624:x1875455681737088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574484.435952:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574484.435965:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8da26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8da1f expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574484.435989:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8da26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8da1f expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574484.435999:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8da26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8da1f expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574484.436008:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217e800, rc 0) 00000100:00100000:2.0:1788574484.436069:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+12:22624:x1875455681737088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574484.436076:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788574484.436122:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681737088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574484.436140:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8da1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8da26 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574484.436150:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8da1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8da26 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574484.436231:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681737216:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788574484.440144:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574484.440219:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574484.440282:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681737216 00000100:00100000:2.0:1788574484.440292:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681737216 00000100:00100000:2.0:1788574484.440339:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788574484.440350:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+12:22624:x1875455681737216:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788574484.445744:0:22619:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788574484.445777:0:22619:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788574484.445787:0:22619:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788574484.445946:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+12:22624:x1875455681737216:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 5594us (5804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574484.445961:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681737216:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788574484.446018:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788574484.446030:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8da1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8da26 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574484.446042:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8da1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8da26 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574484.446090:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788574485.011782:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574485.332382:0:22662:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788574485.332391:0:22662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788574485.332514:0:22662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1788574485.332556:0:22662:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788574485.332709:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1788574485.333543:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00010000:00010000:0.0:1788574486.036405:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574486.355389:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00010000:00010000:2.0:1788574487.059694:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788574487.376504:0:22910:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788574487.380864:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00010000:00010000:0.0:1788574488.084308:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788574488.347623:0:22962:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788574488.348143:0:22962:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788574488.410045:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00000100:00080000:2.0:1788574488.724002:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788574488.724046:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788574488.724051:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85de98f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574488.724073:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 623 00000100:00080000:2.0:1788574488.724081:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788574488.724091:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c85de98f800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574488.724128:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85f6675f80 x1875455681737472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788574488.724146:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574488.724149:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574488.724152:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574488.724155:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574488.724168:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788574488.724172:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788574488.724174:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85c6588800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574488.724180:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c85c6588800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574488.724232:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85f6677100 x1875455681737600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574488.724858:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a90d265-af03-4b80-95da-0de9cffed3f2:3618:1875455681737344:0@lo:400:kworker.0 00000100:00100000:0.0:1788574488.724942:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574488.725220:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681737472:0@lo:38:kworker.0 00000100:00100000:3.0:1788574488.725261:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574488.725284:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875455681737600:0@lo:38:kworker.0 00000100:00100000:3.0:1788574488.725309:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574488.726605:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681737472 00000100:00100000:0.0:1788574488.726621:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681737472 00000100:00100000:0.0:1788574488.726670:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574488.726679:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875455681737472:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788574488.726702:0:22633:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788574488.726792:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875455681737472:12345-0@lo:38:kworker.0 Request processed in 112us (1528us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788574488.726800:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788574488.726856:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85de98f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574488.726862:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788574488.726866:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681737472:0@lo:38:kworker.0 00000100:00100000:2.0:1788574488.728412:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681737344 00000100:00100000:2.0:1788574488.728424:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681737344 00000100:00100000:2.0:1788574488.728474:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788574488.728484:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+12:3618:x1875455681737344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574488.728573:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+12:3618:x1875455681737344:12345-0@lo:400:kworker.0 Request processed in 91us (3630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574488.728580:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788574488.728652:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681737600 00000100:00100000:2.0:1788574488.728656:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681737600 00000100:00100000:2.0:1788574488.728680:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574488.728686:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1875455681737600:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788574488.728709:0:22629:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 628 last 0 00000020:00000080:2.0:1788574488.728751:0:22629:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5bf8706fdac8da2d 00000004:00100000:2.0:1788574488.728767:0:22629:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788574488.728914:0:22629:0:(import.c:65:import_set_state_nolock()) ffff9c8600d3f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574488.728952:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875455681737600:12345-0@lo:38:kworker.0 Request processed in 266us (3642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574488.728959:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788574488.729280:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c85f6677100 x1875455681737600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788574488.729299:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788574488.729307:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788574488.729312:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788574488.729315:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85c6588800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788574488.729321:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875455681737600:0@lo:38:kworker.0 00000100:00100000:0.0:1788574488.729355:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a90d265-af03-4b80-95da-0de9cffed3f2:3618:1875455681737344:0@lo:400:kworker.0 00010000:00010000:2.0:1788574489.108358:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788574489.252764:0:23013:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788574489.252930:0:23013:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788574489.427512:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00010000:00010000:0.0:1788574490.131659:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574490.452470:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00010000:00010000:1.0:1788574491.156865:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574491.475266:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00010000:00010000:0.0:1788574492.179544:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574492.502902:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00010000:00010000:1.0:1788574493.203301:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574493.524258:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00000100:00100000:1.0:1788574493.843446:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574483/real 1788574483] req@ffff9c85f6676300 x1875455681734528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574493 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574493.843480:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:1.0:1788574493.843480:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c85f6676300 x1875455681734528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574493 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574493.843490:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788574493.843496:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c85de98f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574493.843502:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 628 00000100:00080000:2.0:1788574493.843508:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1788574493.843509:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574483/real 1788574483] req@ffff9c85f6676680 x1875455681734400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574493 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574493.843518:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c85de98f800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574493.843526:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c85f6676680 x1875455681734400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574493 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788574493.843544:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85f6de8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574493.843552:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788574493.843554:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85f6676d80 x1875455681737856/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574493.843556:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681734528:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788574493.843567:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85d20ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574493.843575:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574493.843577:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00080000:2.0:1788574493.843583:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:1.0:1788574493.843583:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6676680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681734400:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788574493.843586:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c85d20ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788574493.843664:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574493.843679:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681737728:0@lo:400:kworker.0 00000100:00100000:0.0:1788574493.843750:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574493.845289:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681737728 00000100:00100000:3.0:1788574493.845302:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681737728 00000100:00100000:3.0:1788574493.845351:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788574493.845360:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+12:3620:x1875455681737728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574493.845552:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+12:3620:x1875455681737728:12345-0@lo:400:kworker.0 Request processed in 192us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574493.845561:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788574493.845919:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681737728:0@lo:400:kworker.0 00000100:00080000:2.0:1788574493.850619:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 623 00000100:00080000:2.0:1788574493.850628:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788574493.850636:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c85d20ea800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574493.850705:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681737856:0@lo:38:kworker.0 00000100:00100000:1.0:1788574493.850786:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574493.850901:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85f6674000 x1875455681737984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788574493.850950:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574493.850955:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788574493.850958:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c85f6de8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574493.850963:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 623 00000100:00080000:2.0:1788574493.850966:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788574493.850970:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c85f6de8000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574493.850985:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85f6675500 x1875455681738112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574493.851672:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681738240:0@lo:400:kworker.0 00000100:00100000:2.0:1788574493.851898:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574493.851960:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681738240 00000100:00100000:2.0:1788574493.851968:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681738240 00000100:00100000:2.0:1788574493.852314:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574493.852325:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681738240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574493.852384:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681738240:12345-0@lo:400:kworker.0 Request processed in 61us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574493.852392:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788574493.852451:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c85f6675880 x1875455681738240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574493.852466:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681738240:0@lo:400:kworker.0 00000100:00100000:1.0:1788574493.854064:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681737984:0@lo:8:kworker.0 00000400:00000100:1.0:1788574493.854120:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681737984 offset 0 length 520: 4 00000100:00100000:1.0:1788574493.854156:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681738112:0@lo:8:kworker.0 00000400:00000100:1.0:1788574493.854219:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681738112 offset 0 length 520: 4 00000100:00100000:3.0:1788574493.858772:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681737856 00000100:00100000:3.0:1788574493.858787:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681737856 00000100:00100000:3.0:1788574493.858833:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788574493.858841:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875455681737856:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788574493.858861:0:22632:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788574493.858940:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875455681737856:12345-0@lo:38:kworker.0 Request processed in 98us (8153us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788574493.858953:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788574493.859000:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85de98f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788574493.859005:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788574493.859008:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681737856:0@lo:38:kworker.0 00010000:00010000:0.0:1788574494.228034:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574494.547266:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00010000:00010000:1.0:1788574495.251502:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574495.572150:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788574495.573210:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00000020:01000004:3.0:1788574496.142806:0:23357:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788574496.142810:0:23357:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788574496.142811:0:23357:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788574496.142956:0:23357:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c85fa0fa800 00000020:01000004:3.0:1788574496.142972:0:23357:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788574496.142984:0:23357:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788574496.142998:0:23357:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9c84c2320000) 00000020:00000080:3.0:1788574496.143015:0:23357:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788574496.232435:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788574496.234213:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788574496.235739:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788574496.235997:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788574496.236491:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788574496.237269:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788574496.237987:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788574496.238268:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788574496.238769:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788574496.238994:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788574496.239245:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788574496.239767:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788574496.240014:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788574496.240447:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788574496.240815:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788574496.241163:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788574496.242378:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788574496.242730:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788574496.242948:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788574496.243284:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788574496.243629:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788574496.243838:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788574496.244214:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788574496.246288:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788574496.246826:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788574496.247097:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788574496.247493:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788574496.247730:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788574496.247987:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788574496.248993:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788574496.249319:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788574496.249598:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788574496.251324:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788574496.251679:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788574496.252324:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788574496.252886:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788574496.253237:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788574496.253605:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788574496.253843:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788574496.254074:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788574496.254443:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788574496.254748:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788574496.255180:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788574496.255505:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788574496.255740:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788574496.256040:0:23357:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:01000000:3.0:1788574496.258737:0:23357:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788574496.258958:0:23357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788574496.258970:0:23357:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788574496.258982:0:23357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8da3b 00000020:01000004:3.0:1788574496.258988:0:23357:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788574496.259011:0:23357:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788574496.259015:0:23357:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788574496.259020:0:23357:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788574496.259046:0:23357:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788574496.259051:0:23357:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788574496.267312:0:23357:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788574496.267508:0:23357:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.151@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788574496.267513:0:23357:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788574496.267520:0:23357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788574496.267521:0:23357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574496.267522:0:23357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574496.267524:0:23357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574496.267525:0:23357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574496.267526:0:23357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788574496.267528:0:23357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574496.267529:0:23357:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788574496.267533:0:23357:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788574496.267534:0:23357:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788574496.267535:0:23357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788574496.267536:0:23357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574496.267537:0:23357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574496.267538:0:23357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574496.267539:0:23357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574496.267540:0:23357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788574496.267541:0:23357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574496.267541:0:23357:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788574496.267580:0:23357:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788574496.267600:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681738368:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788574496.267672:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574496.267780:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e51e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574496.269017:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681738368 00000100:00100000:2.0:1788574496.269028:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681738368 00000100:00100000:2.0:1788574496.269204:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788574496.269215:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+12:23357:x1875455681738368:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788574496.269252:0:22622:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788574496.269256:0:22622:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788574496.269264:0:22622:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788574496.272921:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+12:23357:x1875455681738368:12345-0@lo:253:mount.lustre.0 Request processed in 3688us (5228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574496.272953:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788574496.273069:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681738368:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788574496.273104:0:23357:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788574496.273108:0:23357:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788574496.273109:0:23357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788574496.273111:0:23357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574496.273112:0:23357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574496.273113:0:23357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574496.273114:0:23357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574496.273116:0:23357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788574496.273117:0:23357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574496.273119:0:23357:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788574496.273140:0:23357:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c85fa0fa800 from lustre-MDT0001 10000000:01000000:1.0:1788574496.273171:0:23357:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788574496.273174:0:23357:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788574496.273180:0:23357:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c8600d599c0 local copy 00010000:00010000:1.0:1788574496.273221:0:23357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8d931 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d938 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574496.273320:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681738496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574496.273762:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574496.282556:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8a2dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574496.282742:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681738496 00000100:00100000:3.0:1788574496.282753:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681738496 00000100:00100000:3.0:1788574496.282811:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788574496.282822:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+12:23357:x1875455681738496:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574496.282956:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+12:23357:x1875455681738496:12345-0@lo:501:mount.lustre.0 Request processed in 135us (9194us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788574496.282964:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788574496.286608:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681738496:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788574496.286639:0:23357:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788574496.286686:0:23357:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788574496.286697:0:23357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8d931 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d938 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.286727:0:23357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8d931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d938 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574496.286762:0:23357:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c85fa0fa800 10000000:01000000:1.0:1788574496.286768:0:23357:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788574496.286773:0:23357:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c8600d599c0 10000000:01000000:1.0:1788574496.286776:0:23357:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788574496.286779:0:23357:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c8600d599c0 from 1 10000000:01000000:1.0:1788574496.286783:0:23357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788574496.286819:0:23357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3000/0x5bf8706fdac8da42 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.286826:0:23357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3000/0x5bf8706fdac8da42 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.286836:0:23357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3000/0x5bf8706fdac8da42 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574496.286855:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681738624:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788574496.286920:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574496.286967:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8a2dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574496.288799:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681738624 00000100:00100000:3.0:1788574496.288812:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681738624 00000100:00100000:3.0:1788574496.288863:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788574496.288922:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+12:23357:x1875455681738624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574496.288937:0:22619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574496.288966:0:22619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8da49 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8da42 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.288993:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8da49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8da42 expref: 13 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.289004:0:22619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8da49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8da42 expref: 13 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.289013:0:22619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2400, rc 0) 00000100:00100000:3.0:1788574496.289072:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+13:23357:x1875455681738624:12345-0@lo:101:mount.lustre.0 Request processed in 200us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574496.289079:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788574496.290737:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681738624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574496.290761:0:23357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3000/0x5bf8706fdac8da42 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8da49 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.290773:0:23357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3000/0x5bf8706fdac8da42 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8da49 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574496.290809:0:23357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788574496.290833:0:23357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3000/0x5bf8706fdac8da42 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8da49 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.290841:0:23357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3000/0x5bf8706fdac8da42 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8da49 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574496.290852:0:23357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c85fa0fa800 10000000:01000000:1.0:1788574496.290856:0:23357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788574496.290861:0:23357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c85fa0fa800 from 1 10000000:01000000:1.0:1788574496.290864:0:23357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788574496.290891:0:23357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8da50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.290899:0:23357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8da50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.290907:0:23357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8da50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574496.290938:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681738752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788574496.290983:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574496.291014:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8a2dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574496.291227:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681738752 00000100:00100000:3.0:1788574496.291233:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681738752 00000100:00100000:3.0:1788574496.291261:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788574496.291269:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+13:23357:x1875455681738752:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574496.291278:0:22619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574496.291288:0:22619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea3a00/0x5bf8706fdac8da57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8da50 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.291305:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea3a00/0x5bf8706fdac8da57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8da50 expref: 14 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.291315:0:22619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea3a00/0x5bf8706fdac8da57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8da50 expref: 14 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.291324:0:22619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3a00, rc 0) 00000100:00100000:3.0:1788574496.291378:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+14:23357:x1875455681738752:12345-0@lo:101:mount.lustre.0 Request processed in 109us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574496.291392:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1788574496.292019:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574496.293532:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681738752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574496.293557:0:23357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8da50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8da57 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.293569:0:23357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8da50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8da57 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574496.293604:0:23357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788574496.293618:0:23357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8da50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8da57 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.293626:0:23357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8da50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8da57 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574496.293635:0:23357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788574496.293640:0:23357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788574496.293646:0:23357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c85fa0fa800 10000000:01000000:1.0:1788574496.293649:0:23357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788574496.293653:0:23357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788574496.293655:0:23357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788574496.293682:0:23357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3600/0x5bf8706fdac8da5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.293689:0:23357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3600/0x5bf8706fdac8da5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.293697:0:23357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3600/0x5bf8706fdac8da5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574496.293713:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681738880:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788574496.293763:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574496.293801:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8a2dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574496.295021:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681738880 00000100:00100000:0.0:1788574496.295031:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681738880 00000100:00100000:0.0:1788574496.295100:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788574496.295110:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+14:23357:x1875455681738880:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574496.295124:0:22619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574496.295137:0:22619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8da65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8da5e expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574496.295162:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8da65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8da5e expref: 15 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574496.295172:0:22619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8da65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8da5e expref: 15 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574496.295181:0:22619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6c00, rc 0) 00000100:00100000:0.0:1788574496.295261:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+15:23357:x1875455681738880:12345-0@lo:101:mount.lustre.0 Request processed in 152us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574496.295268:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788574496.296468:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681738880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574496.296489:0:23357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3600/0x5bf8706fdac8da5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8da65 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.296514:0:23357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3600/0x5bf8706fdac8da5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8da65 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574496.301398:0:23357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1788574496.302066:0:23357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574496.312522:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788574496.312583:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1788574496.312602:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1788574496.312617:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1788574496.312630:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1788574496.312643:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1788574496.312660:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1788574496.312674:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1788574496.312687:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1788574496.312698:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1788574496.312711:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1788574496.312722:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1788574496.312733:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1788574496.312744:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1788574496.312755:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1788574496.312767:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1788574496.312777:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1788574496.312787:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1788574496.312798:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1788574496.312808:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1788574496.312819:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1788574496.312831:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1788574496.312844:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1788574496.312857:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1788574496.312868:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1788574496.312880:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1788574496.312905:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1788574496.312918:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1788574496.312932:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1788574496.312945:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1788574496.312958:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1788574496.312972:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1788574496.312986:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1788574496.313000:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1788574496.313014:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1788574496.313029:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1788574496.313043:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1788574496.313057:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1788574496.313069:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1788574496.313083:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1788574496.313903:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1788574496.313932:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1788574496.313946:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1788574496.313961:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1788574496.313989:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1788574496.313994:0:23357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1788574496.314106:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681739008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574496.314171:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574496.314237:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8a2d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788574496.314322:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681739008 00000100:00100000:0.0:1788574496.314330:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681739008 00000100:00100000:0.0:1788574496.314406:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788574496.314415:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+15:23357:x1875455681739008:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574496.314547:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+15:23357:x1875455681739008:12345-0@lo:501:mount.lustre.0 Request processed in 133us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574496.314563:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788574496.314819:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681739008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574496.314852:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681739136:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574496.314892:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574496.315019:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8a2d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788574496.320312:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681739136 00000100:00100000:3.0:1788574496.320325:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681739136 00000100:00100000:2.0:1788574496.320615:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788574496.320625:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+15:23357:x1875455681739136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574496.321662:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+15:23357:x1875455681739136:12345-0@lo:503:mount.lustre.0 Request processed in 1036us (6766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574496.321673:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788574496.325639:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681739136:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788574496.330437:0:23357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788574496.330540:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6675880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681739264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574496.330628:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574496.330672:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57a3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574496.330756:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681739264 00000100:00100000:0.0:1788574496.330763:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681739264 00000100:00100000:0.0:1788574496.330818:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788574496.330828:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+15:23357:x1875455681739264:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574496.333321:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+15:23357:x1875455681739264:12345-0@lo:502:mount.lustre.0 Request processed in 2487us (2687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574496.333336:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788574496.333477:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6675880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681739264:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574496.333749:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788574496.333783:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1788574496.333801:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1788574496.333814:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1788574496.333826:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1788574496.333837:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1788574496.333867:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1788574496.333884:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1788574496.333897:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1788574496.333910:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1788574496.333938:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1788574496.333953:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1788574496.333967:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1788574496.333981:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1788574496.333994:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1788574496.334007:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1788574496.334020:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1788574496.334047:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1788574496.334064:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1788574496.334078:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1788574496.334092:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1788574496.334106:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1788574496.334121:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1788574496.334135:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1788574496.334147:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1788574496.334161:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1788574496.334174:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1788574496.334214:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1788574496.334233:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1788574496.334248:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1788574496.334263:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1788574496.334279:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1788574496.334295:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1788574496.334310:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1788574496.334326:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1788574496.334340:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1788574496.334352:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1788574496.334379:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1788574496.334393:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1788574496.334405:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1788574496.334416:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1788574496.334430:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1788574496.334445:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1788574496.334459:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1788574496.334494:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6675880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681739392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574496.334544:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574496.334575:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57a3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574496.334742:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681739392 00000100:00100000:0.0:1788574496.334749:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681739392 00000100:00100000:0.0:1788574496.334798:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788574496.334806:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+15:23357:x1875455681739392:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574496.334926:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+15:23357:x1875455681739392:12345-0@lo:502:mount.lustre.0 Request processed in 119us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574496.334934:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788574496.335586:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6675880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681739392:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574496.335653:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1788574496.335664:0:23357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788574496.338099:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574496.338115:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.338117:0:23361:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788574496.338124:0:23361:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788574496.338127:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574496.338142:0:23361:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9c8600d5b380) 00000020:00000080:2.0:1788574496.338164:0:23361:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788574496.338170:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788574496.338289:0:23361:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788574496.338300:0:23361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8da73 00000020:00000080:2.0:1788574496.338526:0:23361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788574496.338531:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574496.338535:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.338536:0:23361:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788574496.338540:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574496.338544:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.338545:0:23361:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788574496.338548:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574496.338556:0:23361:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9c85faf48000) 00000020:00000080:2.0:1788574496.338566:0:23361:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788574496.338571:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788574496.338573:0:23361:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788574496.338576:0:23361:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788574496.338582:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788574496.338640:0:23361:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c85fa0fa800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788574496.338654:0:23361:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9c85faf4cd40) 00000020:00000080:2.0:1788574496.338663:0:23361:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788574496.338724:0:23361:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788574496.338731:0:23361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8da88 00000020:00000080:2.0:1788574496.338821:0:23361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788574496.338834:0:23361:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788574496.338839:0:23361:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5bf8706fdac8da8f 00080000:01000000:2.0:1788574496.345241:0:23361:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788574496.345285:0:23361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8da96 00010000:00010000:0.0:1788574496.483937:0:23361:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788574496.486572:0:23361:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:0.0:1788574496.487639:0:23361:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788574496.492385:0:23361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788574496.492410:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574496.492616:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.492620:0:23361:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788574496.492626:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574496.492633:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.492634:0:23361:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788574496.492639:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788574496.492644:0:23361:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:00000080:2.0:1788574496.492672:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574496.492689:0:23361:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9c85faf4b380) 00000020:00000080:2.0:1788574496.492711:0:23361:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788574496.492717:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788574496.492796:0:23361:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788574496.492803:0:23361:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788574496.492810:0:23361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8daa4 00010000:00080000:2.0:1788574496.492840:0:23361:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85fa229000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.151@tcp at head 00010000:00010000:2.0:1788574496.496857:0:23361:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788574496.503283:0:23361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788574496.503303:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788574496.503374:0:23361:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788574496.503400:0:23361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8daab 00000100:00080000:1.0:1788574496.503411:0:23361:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788574496.503434:0:23361:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c85fa229000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574496.503473:0:23361:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85c8ab3480 x1875455681739520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788574496.503508:0:23361:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788574496.503549:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788574496.503554:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788574496.503556:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85de98f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574496.503561:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 633 00000100:00080000:1.0:1788574496.503565:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788574496.503569:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c85de98f800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574496.503586:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85c8ab0700 x1875455681739648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574496.503592:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681739520:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788574496.503614:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574496.503619:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574496.503621:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574496.503624:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788574496.503667:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681739776:0@lo:400:kworker.0 00000100:00100000:0.0:1788574496.503686:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574496.503921:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681739520 00000100:00100000:3.0:1788574496.503929:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681739520 00000100:00100000:3.0:1788574496.503962:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574496.503971:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875455681739520:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788574496.504007:0:22632:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 636 last 0 00000020:00000080:3.0:1788574496.504056:0:22632:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8dab2 00000100:00100000:1.0:1788574496.504672:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574496.504726:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681739776 00000100:00100000:1.0:1788574496.504737:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681739776 00000100:00100000:1.0:1788574496.504774:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574496.504780:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681739776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574496.504829:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681739776:12345-0@lo:400:kworker.0 Request processed in 49us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574496.504836:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788574496.504876:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c85c8ab1180 x1875455681739776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574496.504889:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681739776:0@lo:400:kworker.0 00000020:01000000:1.0:1788574496.505809:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574496.505817:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574496.505819:0:23361:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788574496.505823:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788574496.505826:0:23361:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788574496.505827:0:23361:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788574496.505829:0:23361:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788574496.505831:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788574496.505833:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574496.505834:0:23361:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788574496.505837:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574496.505841:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574496.505842:0:23361:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788574496.505846:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788574496.505892:0:23361:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788574496.505919:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574496.505924:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574496.505925:0:23361:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788574496.505927:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788574496.505929:0:23361:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788574496.505930:0:23361:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788574496.505932:0:23361:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788574496.505943:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788574496.505946:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574496.505947:0:23361:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788574496.505950:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788574496.505953:0:23361:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788574496.505956:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574496.505958:0:23361:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788574496.505961:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788574496.505964:0:23361:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:1.0:1788574496.505986:0:23361:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788574496.505988:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788574496.506002:0:23361:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9c84c2513380) 00000020:00000080:1.0:1788574496.506018:0:23361:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788574496.506022:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788574496.506076:0:23361:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788574496.506093:0:23361:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788574496.506099:0:23361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8dac0 00010000:00080000:1.0:1788574496.506126:0:23361:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85c658c800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1788574496.506372:0:23361:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1788574496.508469:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681739648:0@lo:38:kworker.0 00000100:00100000:0.0:1788574496.510767:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1788574496.511274:0:23361:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000004:00100000:3.0:1788574496.514603:0:22632:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788574496.514614:0:22632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788574496.514696:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788574496.514707:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788574496.519402:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681739648 00000100:00100000:1.0:1788574496.519416:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681739648 00000100:00100000:2.0:1788574496.519971:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574496.519981:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3616:x1875455681739648:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788574496.520098:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3616:x1875455681739648:12345-0@lo:38:kworker.0 Request processed in 116us (9335us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788574496.520106:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:01000000:0.0:1788574496.520142:0:23361:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788574496.520215:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574496.520224:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85de98f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574496.520230:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788574496.520235:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681739648:0@lo:38:kworker.0 00000100:00080000:0.0:1788574496.527234:0:22632:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb18000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574496.527333:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1875455681739520:12345-0@lo:38:llog_process_th.0 Request processed in 23360us (23645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574496.527352:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574496.527697:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574496.527708:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788574496.527716:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788574496.527721:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788574496.527731:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85fa229000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788574496.527749:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681739520:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788574496.529112:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681739904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574496.529166:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574496.529280:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681739904 00000100:00100000:0.0:1788574496.529289:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681739904 00000100:00100000:0.0:1788574496.529330:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574496.529339:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1875455681739904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574496.529378:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788574496.529429:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1875455681739904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574496.529436:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788574496.530684:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681739904:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788574496.530875:0:23361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574496.531212:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788574496.531354:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788574496.533107:0:23368:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788574496.533113:0:23368:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788574496.535770:0:23361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788574496.535784:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788574496.535827:0:23361:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788574496.535850:0:23361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8dac7 00000100:00080000:1.0:1788574496.535860:0:23361:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788574496.535867:0:23361:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c85c658c800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574496.535903:0:23361:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85c8ab0700 x1875455681740032/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788574496.535970:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681740032:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788574496.536038:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681740032 offset 0 length 520: 4 00000100:00080000:1.0:1788574496.536585:0:23361:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788574496.536713:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574496.536718:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574496.536720:0:23361:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788574496.536724:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788574496.536726:0:23361:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788574496.536728:0:23361:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788574496.536730:0:23361:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788574496.536731:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788574496.536734:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574496.536736:0:23361:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788574496.536738:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788574496.536742:0:23361:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788574496.536746:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574496.536747:0:23361:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788574496.536751:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788574496.536771:0:23361:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:1.0:1788574496.536796:0:23361:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788574496.536799:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788574496.536813:0:23361:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9c84c2510000) 00000020:00000080:1.0:1788574496.536830:0:23361:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788574496.536835:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788574496.536913:0:23361:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788574496.536920:0:23361:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788574496.536927:0:23361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8dad5 00010000:00080000:1.0:1788574496.536973:0:23361:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c84c369d800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1788574496.537796:0:23361:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788574496.537861:0:23361:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788574496.537876:0:23361:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1788574496.545429:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574496.545439:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788574496.545442:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574496.545446:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788574496.546299:0:23361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574496.546724:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788574496.546860:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1788574496.547292:0:23370:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788574496.547297:0:23370:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788574496.548473:0:23361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788574496.548492:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788574496.548544:0:23361:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788574496.548567:0:23361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8dadc 00000100:00080000:2.0:1788574496.548577:0:23361:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788574496.548584:0:23361:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c84c369d800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574496.548765:0:23361:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85f6675880 x1875455681740160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788574496.548789:0:23361:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788574496.548844:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574496.548848:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.548850:0:23361:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788574496.548853:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574496.548857:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.548859:0:23361:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788574496.548862:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788574496.548864:0:23361:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788574496.548866:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574496.548868:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.548869:0:23361:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788574496.548872:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574496.548874:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.548875:0:23361:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788574496.548878:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788574496.548902:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574496.549060:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.549063:0:23361:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788574496.549067:0:23361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00100000:3.0:1788574496.549353:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681740160:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788574496.549517:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574496.549522:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574496.549524:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574496.549527:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000400:00000100:3.0:1788574496.549641:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681740160 offset 0 length 520: 4 00000020:01000000:0.0:1788574496.552596:0:23357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788574496.552658:0:23357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788574496.552683:0:23357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3600/0x5bf8706fdac8da5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8da65 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574496.552696:0:23357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3600/0x5bf8706fdac8da5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8da65 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574496.552705:0:23357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85fa0fa800 from 1 10000000:01000000:0.0:1788574496.552708:0:23357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788574496.552753:0:23357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8dae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574496.552761:0:23357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8dae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574496.552772:0:23357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8dae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574496.552808:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681740288:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788574496.552872:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574496.552936:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafeee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574496.554033:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681740288 00000100:00100000:1.0:1788574496.554043:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681740288 00000100:00100000:1.0:1788574496.554110:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788574496.554120:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+15:23357:x1875455681740288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574496.554134:0:22619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574496.554148:0:22619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d08a2a00/0x5bf8706fdac8daea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8dae3 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.554209:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d08a2a00/0x5bf8706fdac8daea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8dae3 expref: 16 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.554221:0:22619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d08a2a00/0x5bf8706fdac8daea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8dae3 expref: 16 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.554231:0:22619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a2a00, rc 0) 00000100:00100000:1.0:1788574496.554293:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+16:23357:x1875455681740288:12345-0@lo:101:mount.lustre.0 Request processed in 173us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574496.554301:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788574496.554328:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681740288:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574496.554347:0:23357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8dae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8daea expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.554378:0:23357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8dae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8daea expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574496.555402:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681740416:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788574496.555453:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574496.555583:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e51600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574496.555653:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681740416 00000100:00100000:0.0:1788574496.555660:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681740416 00000100:00100000:0.0:1788574496.555704:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788574496.555713:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+16:23357:x1875455681740416:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788574496.555729:0:22621:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788574496.555746:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788574496.555750:0:22621:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788574496.556344:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+16:23357:x1875455681740416:12345-0@lo:256:mount.lustre.0 Request processed in 631us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574496.556353:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788574496.556471:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681740416:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788574496.560778:0:23357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788574496.560818:0:23357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8dae3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8daea expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.560831:0:23357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8dae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8daea expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574496.561371:0:23357:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85fa0fa800 from 1 10000000:01000000:3.0:1788574496.561375:0:23357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574496.561417:0:23357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2600/0x5bf8706fdac8daf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.561425:0:23357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea2600/0x5bf8706fdac8daf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.561435:0:23357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea2600/0x5bf8706fdac8daf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574496.561457:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681740544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788574496.561638:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574496.561782:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e51600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574496.568484:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681740544 00000100:00100000:0.0:1788574496.568606:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681740544 00000100:00100000:1.0:1788574496.568745:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788574496.568756:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+16:23357:x1875455681740544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574496.568774:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574496.568792:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8daf8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8daf1 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.568820:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8daf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8daf1 expref: 17 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.568830:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8daf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8daf1 expref: 17 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.568839:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a3a00, rc 0) 00000100:00100000:1.0:1788574496.568922:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+17:23357:x1875455681740544:12345-0@lo:101:mount.lustre.0 Request processed in 168us (7284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574496.568939:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788574496.569097:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681740544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574496.569117:0:23357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea2600/0x5bf8706fdac8daf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8daf8 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.569126:0:23357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2600/0x5bf8706fdac8daf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8daf8 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788574496.570740:0:23357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1788574496.571186:0:23357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788574496.571813:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788574496.571840:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1788574496.571856:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1788574496.571867:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1788574496.571877:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1788574496.571888:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1788574496.571900:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1788574496.572037:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:3.0:1788574496.572056:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788574496.572070:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:3.0:1788574496.574595:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:3.0:1788574496.574672:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:3.0:1788574496.574680:0:23357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1788574496.574790:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681740672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574496.574858:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574496.574898:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574496.574943:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681740672 00000100:00100000:0.0:1788574496.574951:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681740672 00000100:00100000:0.0:1788574496.575075:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788574496.575086:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+17:23357:x1875455681740672:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574496.575242:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+17:23357:x1875455681740672:12345-0@lo:501:mount.lustre.0 Request processed in 158us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574496.575250:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788574496.575614:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681740672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574496.575667:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681740800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574496.575707:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574496.575729:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa319240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574496.576467:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681740800 00000100:00100000:0.0:1788574496.576483:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681740800 00000100:00100000:0.0:1788574496.576536:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788574496.576543:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+17:23357:x1875455681740800:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574496.577864:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+17:23357:x1875455681740800:12345-0@lo:503:mount.lustre.0 Request processed in 1316us (2150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574496.577876:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788574496.578941:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681740800:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788574496.579775:0:23357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788574496.579859:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681740928:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574496.585790:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574496.585838:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574496.585951:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681740928 00000100:00100000:0.0:1788574496.585970:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681740928 00000100:00100000:0.0:1788574496.586041:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788574496.586051:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+17:23357:x1875455681740928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574496.586219:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+17:23357:x1875455681740928:12345-0@lo:502:mount.lustre.0 Request processed in 169us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574496.586228:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788574496.586480:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681740928:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788574496.586728:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788574496.586760:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1788574496.586773:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1788574496.586784:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1788574496.586794:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1788574496.586805:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1788574496.586820:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1788574496.586832:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1788574496.586846:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788574496.586859:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1788574496.586871:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1788574496.586917:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681741056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574496.588235:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574496.588373:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e51600 going to sleep for 11 seconds 00000100:00100000:1.0:1788574496.589227:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681741056 00000100:00100000:1.0:1788574496.589238:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681741056 00000100:00100000:1.0:1788574496.589291:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788574496.589300:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+17:23357:x1875455681741056:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574496.589549:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+17:23357:x1875455681741056:12345-0@lo:502:mount.lustre.0 Request processed in 249us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574496.589557:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788574496.589700:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681741056:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788574496.589778:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1788574496.589791:0:23357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788574496.594878:0:23372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574496.594892:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.594894:0:23372:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788574496.594903:0:23372:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c85fa0fa800 00000020:00000080:2.0:1788574496.594918:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788574496.594946:0:23372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574496.594949:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.594951:0:23372:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788574496.594954:0:23372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574496.594956:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.594958:0:23372:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788574496.594961:0:23372:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c85fa0fa800 00000020:00000080:2.0:1788574496.594963:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788574496.595024:0:23372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574496.595028:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.595029:0:23372:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788574496.595032:0:23372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574496.595035:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.595036:0:23372:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788574496.595039:0:23372:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c85fa0fa800 00000020:00000080:2.0:1788574496.595041:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788574496.595058:0:23372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574496.595060:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.595062:0:23372:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788574496.595064:0:23372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574496.595066:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.595067:0:23372:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788574496.595070:0:23372:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c85fa0fa800 00000020:00000080:2.0:1788574496.595072:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788574496.595113:0:23372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574496.595116:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574496.595118:0:23372:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788574496.595121:0:23372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1788574496.595421:0:23357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788574496.595451:0:23357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574496.595465:0:23357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2600/0x5bf8706fdac8daf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8daf8 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.595477:0:23357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea2600/0x5bf8706fdac8daf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8daf8 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574496.595522:0:23357:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788574496.595532:0:23357:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c85fa0fa800 10000000:01000000:3.0:1788574496.595535:0:23357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c85fa0fa800 10000000:01000000:3.0:1788574496.595539:0:23357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788574496.595545:0:23357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85fa0fa800 from 1 10000000:01000000:3.0:1788574496.595548:0:23357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788574496.595583:0:23357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2200/0x5bf8706fdac8daff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.595593:0:23357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea2200/0x5bf8706fdac8daff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.595604:0:23357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea2200/0x5bf8706fdac8daff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574496.595627:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681741184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788574496.595691:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574496.595743:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e51600 going to sleep for 11 seconds 00000100:00100000:2.0:1788574496.599377:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681741184 00000100:00100000:2.0:1788574496.599390:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681741184 00000100:00100000:2.0:1788574496.599448:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788574496.599460:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+17:23357:x1875455681741184:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574496.599476:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574496.599501:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217e200/0x5bf8706fdac8db06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8daff expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.599533:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217e200/0x5bf8706fdac8db06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8daff expref: 18 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.599545:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217e200/0x5bf8706fdac8db06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8daff expref: 18 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.599554:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217e200, rc 0) 00000100:00100000:2.0:1788574496.599641:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+18:23357:x1875455681741184:12345-0@lo:101:mount.lustre.0 Request processed in 184us (3949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574496.599649:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788574496.599720:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00000100:00100000:3.0:1788574496.599758:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681741184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574496.599778:0:23357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea2200/0x5bf8706fdac8daff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db06 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.599789:0:23357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2200/0x5bf8706fdac8daff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8db06 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788574496.602515:0:23357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1788574496.602869:0:23357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788574496.604003:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788574496.604035:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1788574496.604047:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1788574496.604071:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788574496.611146:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788574496.611182:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788574496.611224:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788574496.611239:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788574496.611254:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788574496.611268:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788574496.611282:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788574496.611296:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788574496.611310:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788574496.611321:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788574496.611684:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788574496.611706:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788574496.611723:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788574496.611736:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788574496.611747:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788574496.611760:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788574496.611773:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788574496.611786:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788574496.611815:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788574496.611833:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788574496.611847:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788574496.611858:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788574496.611871:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788574496.611884:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788574496.611900:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788574496.611912:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788574496.611960:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788574496.611977:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788574496.611992:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788574496.612007:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788574496.612018:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788574496.612032:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788574496.612045:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788574496.612057:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788574496.612070:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788574496.612101:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788574496.612115:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788574496.612128:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788574496.612141:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788574496.612154:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788574496.612167:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788574496.612180:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788574496.612237:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788574496.612253:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788574496.612467:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788574496.612490:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788574496.612508:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788574496.612513:0:23357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788574496.612655:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681741312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574496.612749:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574496.612822:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57a39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574496.618240:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681741312 00000100:00100000:1.0:1788574496.618257:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681741312 00000100:00100000:1.0:1788574496.618365:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788574496.618376:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+18:23357:x1875455681741312:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574496.618560:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+18:23357:x1875455681741312:12345-0@lo:501:mount.lustre.0 Request processed in 185us (5811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574496.618567:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788574496.624217:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681741312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574496.624291:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681741440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574496.624379:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574496.624418:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681741440 00000100:00100000:2.0:1788574496.624425:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681741440 00000100:00100000:2.0:1788574496.624472:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788574496.624480:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+18:23357:x1875455681741440:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574496.624580:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+18:23357:x1875455681741440:12345-0@lo:503:mount.lustre.0 Request processed in 100us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574496.624588:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788574496.627477:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57a39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574496.627524:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681741440:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788574496.628385:0:23357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788574496.628470:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681741568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574496.628547:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574496.628595:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681741568 00000100:00100000:2.0:1788574496.629684:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681741568 00000100:00100000:2.0:1788574496.629739:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788574496.629748:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+18:23357:x1875455681741568:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574496.629875:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+18:23357:x1875455681741568:12345-0@lo:502:mount.lustre.0 Request processed in 127us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574496.629883:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788574496.630075:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57a39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574496.631314:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681741568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574496.631560:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788574496.631591:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1788574496.632171:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1788574496.632213:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1788574496.632231:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1788574496.632248:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1788574496.633036:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1788574496.633064:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1788574496.633371:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788574496.633391:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1788574496.633405:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1788574496.633419:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1788574496.633432:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1788574496.633446:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1788574496.633458:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1788574496.633471:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1788574496.633485:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1788574496.633499:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1788574496.633512:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1788574496.633524:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1788574496.633536:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1788574496.633546:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1788574496.633557:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1788574496.633571:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1788574496.635018:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1788574496.635073:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1788574496.635507:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1788574496.635531:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1788574496.635547:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1788574496.635562:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1788574496.635578:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1788574496.635592:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1788574496.638669:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1788574496.638688:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1788574496.638702:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1788574496.638716:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1788574496.638730:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1788574496.638744:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1788574496.638759:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1788574496.638773:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1788574496.638807:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1788574496.638822:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1788574496.638836:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1788574496.638849:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1788574496.638863:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1788574496.638877:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1788574496.638888:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1788574496.638899:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1788574496.638965:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681741696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574496.639044:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574496.639104:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681741696 00000100:00100000:2.0:1788574496.639112:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681741696 00000100:00100000:2.0:1788574496.639158:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788574496.639169:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+18:23357:x1875455681741696:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574496.639561:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+18:23357:x1875455681741696:12345-0@lo:502:mount.lustre.0 Request processed in 392us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574496.639569:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788574496.639645:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57a39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574496.639670:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681741696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574496.639852:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788574496.639876:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788574496.639909:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681741824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574496.640055:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574496.640149:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681741824 00000100:00100000:2.0:1788574496.640155:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681741824 00000100:00100000:2.0:1788574496.640184:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788574496.640213:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+18:23357:x1875455681741824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574496.640369:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+18:23357:x1875455681741824:12345-0@lo:502:mount.lustre.0 Request processed in 178us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574496.640376:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788574496.640417:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57a39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574496.640431:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681741824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574496.640469:0:23357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1788574496.640477:0:23357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788574496.641578:0:23377:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788574496.641593:0:23377:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9c85faf499c0) 00000020:00000080:2.0:1788574496.641702:0:23377:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788574496.641791:0:23377:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c85fa0fa800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788574496.641796:0:23377:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85fa0fa800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788574496.641798:0:23377:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85fa0fa800 3 00010000:00080000:2.0:1788574496.641830:0:23377:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85c2bfe800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.151@tcp at head 00010000:00010000:2.0:1788574496.649712:0:23377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788574496.650656:0:23377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788574496.650721:0:23377:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788574496.651179:0:23377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5bf8706fdac8db14 00000100:00080000:2.0:1788574496.651217:0:23377:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788574496.651224:0:23377:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c85c2bfe800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574496.651256:0:23377:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85f6677800 x1875455681741952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788574496.651294:0:23377:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788574496.651447:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875455681741952:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788574496.651516:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574496.651609:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681741952 00000100:00100000:2.0:1788574496.651617:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681741952 00000100:00080000:1.0:1788574496.651682:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788574496.651685:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788574496.651688:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574496.651690:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788574496.651693:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1875455681741952:12345-0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788574496.651693:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1788574496.651716:0:22629:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 636 last 0 00000020:00000080:2.0:1788574496.652114:0:22629:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5bf8706fdac8db1b 00000004:00100000:2.0:1788574496.652131:0:22629:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788574496.652161:0:22629:0:(import.c:65:import_set_state_nolock()) ffff9c85fa22d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574496.652349:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875455681741952:12345-0@lo:38:llog_process_th.0 Request processed in 654us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574496.652367:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1788574496.652465:0:23377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1788574496.652513:0:23357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788574496.652540:0:23357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788574496.652554:0:23357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2200/0x5bf8706fdac8daff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db06 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.652565:0:23357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea2200/0x5bf8706fdac8daff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db06 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788574496.652608:0:23357:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788574496.652610:0:23357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788574496.652611:0:23357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574496.652612:0:23357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574496.652613:0:23357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574496.652614:0:23357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574496.652616:0:23357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788574496.652617:0:23357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574496.652622:0:23357:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788574496.652625:0:23357:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788574496.652627:0:23357:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788574496.652629:0:23357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788574496.652630:0:23357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574496.652630:0:23357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574496.652631:0:23357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574496.652632:0:23357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574496.652633:0:23357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788574496.652634:0:23357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574496.652635:0:23357:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788574496.652650:0:23357:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788574496.652663:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681742080:0@lo:253:mount.lustre.0 00010000:00080000:0.0:1788574496.652710:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c85f6677800 x1875455681741952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574496.652721:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788574496.652823:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788574496.652831:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788574496.652835:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788574496.652837:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85c2bfe800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788574496.652843:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875455681741952:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788574496.653384:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574496.653416:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c7de6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574496.654985:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681742080 00000100:00100000:2.0:1788574496.654996:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681742080 00000100:00100000:2.0:1788574496.655040:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788574496.655048:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+18:23357:x1875455681742080:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788574496.655075:0:22622:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788574496.655087:0:22622:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788574496.660824:0:22607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788574496.660889:0:22622:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788574496.660948:0:22622:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788574496.661485:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+18:23357:x1875455681742080:12345-0@lo:253:mount.lustre.0 Request processed in 6432us (8095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574496.661499:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788574496.661503:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:23357:1875455681742080:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788574496.661517:0:23357:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788574496.661520:0:23357:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788574496.661522:0:23357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788574496.661523:0:23357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574496.661524:0:23357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574496.661525:0:23357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574496.661526:0:23357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574496.661527:0:23357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788574496.661529:0:23357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574496.661530:0:23357:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788574496.661551:0:23357:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788574496.664231:0:22643:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788574496.664241:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788574496.664264:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8db22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.664283:0:22643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8da26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8da1f expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.664291:0:22643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d08a2a00/0x5bf8706fdac8daea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8dae3 expref: 17 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.664298:0:22643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8db22 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.664339:0:22643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d08a2a00/0x5bf8706fdac8daea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8dae3 expref: 17 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.664365:0:22643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85d08a2a00/0x5bf8706fdac8daea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8dae3 expref: 17 pid: 22619 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574496.664380:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22643:1875455681742208:0@lo:104: 00000100:00100000:3.0:1788574496.664442:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574496.664498:0:22643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8da26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8da1f expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.664507:0:22643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8da26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8da1f expref: 17 pid: 22621 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574496.664516:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22643:1875455681742336:0@lo:104: 00000100:00100000:3.0:1788574496.664545:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574496.664562:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e51600 going to sleep for 11 seconds 00000100:00100000:2.0:1788574496.664872:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681742208 00000100:00100000:2.0:1788574496.664879:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681742208 00000100:00100000:2.0:1788574496.664914:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681742336 00000100:00100000:2.0:1788574496.664917:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681742336 00000100:00100000:2.0:1788574496.664931:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574496.664940:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+4:22643:x1875455681742208:12345-0@lo:104: 00010000:00010000:2.0:1788574496.664953:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8dae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8daea expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665005:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574496.665011:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+4:22643:x1875455681742208:12345-0@lo:104: Request processed in 73us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574496.665018:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574496.665034:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574496.665040:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+3:22643:x1875455681742336:12345-0@lo:104: 00010000:00010000:2.0:1788574496.665048:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8da1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8da26 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665081:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788574496.665085:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+3:22643:x1875455681742336:12345-0@lo:104: Request processed in 46us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574496.665092:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788574496.665107:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574496.665112:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8dae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8daea expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665119:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7200 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574496.665123:0:22615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8dae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8daea expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665139:0:22615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8dae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8daea expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574496.665146:0:22615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8dae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8daea expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574496.665151:0:22615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574496.665178:0:22615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8dae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8daea expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665185:0:22615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574496.665217:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8dae3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8daea expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665224:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8dae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8daea expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665234:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574496.665237:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8da1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8da26 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665243:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2a00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574496.665246:0:22615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8da1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8da26 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665253:0:22615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8da1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8da26 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574496.665259:0:22615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8da1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8da26 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574496.665269:0:22615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574496.665284:0:22615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8da1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8da26 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665290:0:22615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574496.665297:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8da1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8da26 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665303:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8da1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8da26 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665315:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574496.665316:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574496.665318:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574496.665336:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a90d265-af03-4b80-95da-0de9cffed3f2:3619:1875455681742464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574496.665375:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574496.665404:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574496.665411:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a90d265-af03-4b80-95da-0de9cffed3f2:3619:1875455681742592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574496.665431:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574496.665460:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681742464 00000100:00100000:2.0:1788574496.665464:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681742464 00010000:00010000:2.0:1788574496.665480:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d08a2a00/0x5bf8706fdac8daea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8dae3 expref: 18 pid: 22619 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574496.665499:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681742592 00000100:00100000:2.0:1788574496.665502:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681742592 00010000:00010000:2.0:1788574496.665512:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8da26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8da1f expref: 19 pid: 22621 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574496.665537:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574496.665543:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6674a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+19:3619:x1875455681742464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574496.665554:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574496.665559:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d08a2a00/0x5bf8706fdac8daea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8dae3 expref: 19 pid: 22619 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665569:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d08a2a00/0x5bf8706fdac8daea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8dae3 expref: 19 pid: 22619 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665583:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574496.665609:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6674a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+19:3619:x1875455681742464:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574496.665615:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574496.665627:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574496.665633:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6675c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+18:3619:x1875455681742592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574496.665640:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574496.665645:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8da26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8da1f expref: 18 pid: 22621 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665653:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8da26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8da1f expref: 18 pid: 22621 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665665:0:22612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8db22 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665673:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8db22 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788574496.665695:0:22612:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005426108s 00010000:00010000:2.0:1788574496.665700:0:22612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8db22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665707:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8db22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665713:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8db22 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.665720:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8db22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574496.666076:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574496.666423:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d08a2a00/0x5bf8706fdac8daea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8dae3 expref: 18 pid: 22619 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574496.666434:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22643:1875455681742208:0@lo:104: 00010000:00010000:3.0:1788574496.666444:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8da26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8da1f expref: 17 pid: 22621 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574496.666452:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22643:1875455681742336:0@lo:104: 00010000:00010000:3.0:1788574496.666471:0:22643:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8db22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.666480:0:22643:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8db22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574496.666486:0:22643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8db22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.666573:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574496.666577:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8db22 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.666586:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8db22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.666595:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8db22 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.666602:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8db22 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574496.666614:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574496.666648:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6675c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+16:3619:x1875455681742592:12345-0@lo:103:ldlm_bl.0 Request processed in 1015us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574496.666655:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574496.666694:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a90d265-af03-4b80-95da-0de9cffed3f2:3619:1875455681742592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574496.666703:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a90d265-af03-4b80-95da-0de9cffed3f2:3619:1875455681742464:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1788574496.667930:0:23357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1788574496.671531:0:23385:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788574496.672222:0:23357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1788574496.672790:0:23385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788574496.673316:0:23357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788574496.673422:0:23357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788574496.673899:0:23357:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788574496.673906:0:23357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788574496.673941:0:23357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1788574496.674716:0:23384:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788574496.674721:0:23384:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:1.0:1788574496.674995:0:23357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788574496.675560:0:23357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788574496.675589:0:23357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788574496.675666:0:23357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788574496.676447:0:23357:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:1.0:1788574496.676838:0:23386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23386:1875455681742720:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788574496.677522:0:23386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574496.677557:0:23386:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c384f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788574496.677824:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681742720 00000100:00100000:3.0:1788574496.677832:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681742720 00000100:00100000:3.0:1788574496.677892:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574496.677901:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23386:x1875455681742720:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788574496.678096:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23386:x1875455681742720:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 195us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574496.678103:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00000004:1.0:1788574496.678598:0:23357:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1788574496.678670:0:23386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23386:1875455681742720:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788574496.678700:0:23386:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788574496.678731:0:23386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23386:1875455681742848:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788574496.678763:0:23386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574496.678789:0:23386:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574496.679012:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681742848 00000100:00100000:2.0:1788574496.679018:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681742848 00000100:00100000:2.0:1788574496.679095:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788574496.679102:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23386:x1875455681742848:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788574496.679234:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23386:x1875455681742848:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 133us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574496.679242:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788574496.679272:0:23386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23386:1875455681742848:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788574496.679329:0:23386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23386:1875455681742976:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788574496.679369:0:23386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574496.679385:0:23386:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353bcc0 going to sleep for 11 seconds 00000040:00080000:0.0:1788574496.679710:0:23385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788574496.679782:0:23385:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1788574496.680449:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681742976 00000100:00100000:2.0:1788574496.680455:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681742976 00000100:00100000:2.0:1788574496.680476:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574496.680480:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23386:x1875455681742976:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788574496.680555:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23386:x1875455681742976:12345-0@lo:900:lod0001_rec0000.0 Request processed in 74us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574496.680560:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788574496.680688:0:23386:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c85c8ab2d80 x1875455681742976/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788574512 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574496.680701:0:23386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23386:1875455681742976:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788574496.680749:0:23386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23386:1875455681743104:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788574496.680784:0:23386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574496.680831:0:23386:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574496.680864:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681743104 00000100:00100000:0.0:1788574496.680870:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681743104 00000100:00100000:0.0:1788574496.681048:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788574496.681057:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23386:x1875455681743104:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788574496.681122:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23386:x1875455681743104:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 66us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574496.681129:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788574496.681180:0:23386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23386:1875455681743104:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788574496.681730:0:23386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574496.683791:0:23386:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788574496.683855:0:23386:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788574496.683859:0:23386:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1788574496.686185:0:23357:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788574496.687088:0:23357:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb4d281c7b988 00100000:10000000:2.0:1788574496.687096:0:23357:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788574496.689825:0:23357:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788574496.689919:0:23357:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788574496.690919:0:23357:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788574496.690952:0:23357:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788574496.695094:0:23357:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788574496.695654:0:23357:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788574497.302055:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574497.620255:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00000040:00080000:2.0:1788574497.683799:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788574498.007419:0:22624:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788574498.007427:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85fa0fa800 from 12 10000000:01000000:3.0:1788574498.007433:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788574498.007480:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3000/0x5bf8706fdac8db29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.007493:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea3000/0x5bf8706fdac8db29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.007505:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea3000/0x5bf8706fdac8db29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574498.007530:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681743232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574498.007596:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574498.007641:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788574498.007666:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681743232 00000100:00100000:3.0:1788574498.007672:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681743232 00000100:00100000:3.0:1788574498.007716:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788574498.007724:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+16:22624:x1875455681743232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574498.007736:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574498.007747:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea3200/0x5bf8706fdac8db30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8db29 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.007770:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea3200/0x5bf8706fdac8db30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8db29 expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.007780:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea3200/0x5bf8706fdac8db30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8db29 expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.007801:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3200, rc 0) 00000100:00100000:3.0:1788574498.007840:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+17:22624:x1875455681743232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574498.007846:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788574498.007894:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681743232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574498.007908:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea3000/0x5bf8706fdac8db29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db30 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.007917:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea3000/0x5bf8706fdac8db29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8db30 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574498.007963:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681743360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788574498.007992:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574498.008006:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bd600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574498.018968:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681743360 00000100:00100000:0.0:1788574498.018983:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681743360 00000100:00100000:0.0:1788574498.019046:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788574498.019056:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+17:22624:x1875455681743360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788574498.019266:0:22622:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788574498.019296:0:22622:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788574498.019300:0:22622:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788574498.019433:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+17:22624:x1875455681743360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 378us (11438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574498.019441:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788574498.022307:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681743360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788574498.022384:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788574498.022395:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3000/0x5bf8706fdac8db29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db30 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574498.022405:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea3000/0x5bf8706fdac8db29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db30 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574498.022416:0:22624:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788574498.022419:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c84c2291800 from 12 10000000:01000000:1.0:1788574498.022422:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788574498.022455:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8db37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574498.022462:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8db37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574498.022471:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8db37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574498.022491:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681743488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574498.022542:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574498.022585:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788574498.022791:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681743488 00000100:00100000:2.0:1788574498.022800:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681743488 00000100:00100000:2.0:1788574498.022860:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788574498.022869:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+17:22624:x1875455681743488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574498.022891:0:22619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574498.022904:0:22619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8db3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8db37 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574498.022930:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8db3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8db37 expref: 18 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574498.022940:0:22619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8db3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8db37 expref: 18 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574498.022949:0:22619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217fa00, rc 0) 00000100:00100000:2.0:1788574498.022987:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+18:22624:x1875455681743488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574498.022994:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788574498.023530:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681743488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574498.023545:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8db37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db3e expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574498.023563:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8db37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8db3e expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574498.023604:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681743616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788574498.023634:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574498.023650:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788574498.023705:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681743616 00000100:00100000:2.0:1788574498.023709:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681743616 00000100:00100000:2.0:1788574498.023732:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788574498.023738:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+18:22624:x1875455681743616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788574498.023751:0:22621:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788574498.023766:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788574498.023769:0:22621:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788574498.023847:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+18:22624:x1875455681743616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574498.023862:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788574498.024467:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681743616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788574498.024508:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788574498.024514:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8db37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db3e expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574498.024523:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8db37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db3e expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574498.324625:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574498.646371:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00000040:00080000:0.0:1788574498.711169:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788574499.347429:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574499.669351:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00010000:00010000:1.0:1788574500.374019:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574500.691380:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00010000:00010000:0.0:1788574501.402317:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788574501.547372:0:23628:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788574501.718232:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 0 seconds 00000100:00100000:3.0:1788574502.035870:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574502.035895:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681743744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574502.035975:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574502.036183:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681743744 00000100:00100000:0.0:1788574502.036216:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681743744 00000100:00100000:0.0:1788574502.036279:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788574502.036291:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681743744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574502.036332:0:23367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788574502.036401:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681743744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574502.036408:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574502.036644:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681743744:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788574502.037662:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788574502.037669:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788574502.037673:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c85de98f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574502.037682:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c85de98f800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574502.037787:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85f6676a00 x1875455681744000/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788574502.037809:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574502.037813:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574502.037816:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574502.037820:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574502.037842:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574502.037846:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574502.037849:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788574502.037852:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681744128:0@lo:400:kworker.0 00000100:00080000:2.0:1788574502.037854:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788574502.037891:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681744000:0@lo:38:kworker.0 00000100:00100000:0.0:1788574502.037911:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574502.037941:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574502.037948:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681744256:0@lo:400:kworker.0 00000100:00100000:0.0:1788574502.037969:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574502.038001:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681744128 00000100:00100000:0.0:1788574502.038007:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681744128 00000100:00100000:0.0:1788574502.038040:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681744256 00000100:00100000:0.0:1788574502.038044:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681744256 00000100:00100000:0.0:1788574502.038059:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574502.038068:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681744128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574502.038092:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574502.038107:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a90d265-af03-4b80-95da-0de9cffed3f2:3617:1875455681743872:0@lo:400:kworker.0 00000100:00100000:0.0:1788574502.038117:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681744128:12345-0@lo:400:kworker.0 Request processed in 49us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574502.038148:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574502.038209:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574502.038210:0:22628:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574502.038220:0:22628:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788574502.038228:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574502.038236:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681744256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574502.038240:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681743872 00000100:00100000:1.0:1788574502.038245:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681743872 00000100:00100000:0.0:1788574502.038283:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681744256:12345-0@lo:400:kworker.0 Request processed in 48us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574502.038291:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574502.038295:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788574502.038305:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+18:3617:x1875455681743872:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788574502.038331:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85f6676d80 x1875455681744256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574502.038345:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681744256:0@lo:400:kworker.0 00000100:00100000:1.0:1788574502.038348:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+18:3617:x1875455681743872:12345-0@lo:400:kworker.0 Request processed in 43us (198us total) trans 0 rc 0/0 00010000:00080000:0.0:1788574502.038361:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85f6677800 x1875455681744128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574502.038366:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788574502.038381:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681744128:0@lo:400:kworker.0 00000100:00100000:0.0:1788574502.038431:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a90d265-af03-4b80-95da-0de9cffed3f2:3617:1875455681743872:0@lo:400:kworker.0 00000100:00100000:2.0:1788574502.038523:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574502.038890:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681744000 00000100:00100000:0.0:1788574502.038895:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681744000 00000100:00100000:0.0:1788574502.038927:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788574502.038932:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875455681744000:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788574502.038955:0:22633:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 642 last 0 00000020:00000080:0.0:1788574502.038989:0:22633:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8db45 00000004:00100000:0.0:1788574502.039003:0:22633:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788574502.039011:0:22633:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1788574502.075454:0:22633:0:(import.c:65:import_set_state_nolock()) ffff9c85c8a35000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574502.075564:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1875455681744000:12345-0@lo:38:kworker.0 Request processed in 36629us (37039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574502.075580:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788574502.075687:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788574502.075697:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788574502.075702:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788574502.075705:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85de98f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788574502.075739:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005c1084ea): req@ffff9c85fb9b6d80 x1875455681736960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574502.075762:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681744000:0@lo:38:kworker.0 00000100:00100000:0.0:1788574502.075886:0:22668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574502.075923:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574502.076039:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681744384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574502.076067:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574502.076141:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681736960 00000100:00100000:3.0:1788574502.076148:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681736960 00000100:00100000:3.0:1788574502.076187:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681744384 00000100:00100000:3.0:1788574502.076212:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681744384 00000100:00100000:3.0:1788574502.076238:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574502.076247:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22668:x1875455681736960:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788574502.076339:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22668:x1875455681736960:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 93us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574502.076346:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574502.076361:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788574502.076367:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1875455681744384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788574502.076392:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788574502.081634:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1875455681744384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5248us (5547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574502.081653:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788574502.081740:0:22668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22668:1875455681736960:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788574502.081743:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681744384:0@lo:41:osp-pre-1-0.0 00000040:01000000:3.0:1788574502.081794:0:22668:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788574502.081862:0:22668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22668:1875455681744512:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788574502.081931:0:22668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574502.081957:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa2de540 going to sleep for 11 seconds 00000100:00100000:1.0:1788574502.083514:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681744512 00000100:00100000:1.0:1788574502.083528:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681744512 00000100:00100000:1.0:1788574502.083596:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788574502.083607:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22668:x1875455681744512:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788574502.083787:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22668:x1875455681744512:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 181us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574502.083796:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788574502.083807:0:22668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22668:1875455681744512:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788574502.083911:0:22668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22668:1875455681744640:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788574502.083952:0:22668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574502.083993:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa2de540 going to sleep for 11 seconds 00000100:00100000:0.0:1788574502.084216:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681744640 00000100:00100000:0.0:1788574502.084222:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681744640 00000100:00100000:0.0:1788574502.084272:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574502.084280:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22668:x1875455681744640:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788574502.084350:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22668:x1875455681744640:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574502.084358:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788574502.084493:0:22668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22668:1875455681744640:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788574502.084842:0:22668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788574502.088028:0:22668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788574502.088134:0:22668:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1788574502.088139:0:22668:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788574502.419325:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788574502.511390:0:23681:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788574502.511701:0:23681:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788574503.443509:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788574503.772466:0:23732:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788574503.773705:0:23732:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788574504.468833:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788574505.313523:0:23780:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4fc69d70 20000000:00000080:0.0:1788574505.313553:0:23780:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c85eb6c1000 uarg=0000000000000000 20000000:01000000:0.0:1788574505.313603:0:23780:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788574505.313611:0:23780:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788574505.313618:0:23780:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788574505.315233:0:23781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788574505.315622:0:23780:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788574505.324428:0:23780:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788574505.324542:0:23780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8db4c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574505.324565:0:23780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d9f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d9ee expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574505.324572:0:23780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8daf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8daf1 expref: 17 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574505.324580:0:23780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8db4c lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574505.324628:0:23780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8daf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8daf1 expref: 17 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574505.324643:0:23780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8daf8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8daf1 expref: 17 pid: 22622 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574505.324657:0:23780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6676a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23780:1875455681744768:0@lo:104: 00000100:00100000:2.0:1788574505.332372:0:23780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788574505.332530:0:23780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d9f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8d9ee expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574505.332547:0:23780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d9f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8d9ee expref: 17 pid: 22621 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574505.332583:0:23780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23780:1875455681744896:0@lo:104: 00000100:00100000:2.0:1788574505.332630:0:23780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574505.337229:0:23780:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788574505.337937:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681744768 00000100:00100000:0.0:1788574505.337948:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681744768 00000100:00100000:3.0:1788574505.338055:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681744896 00000100:00100000:3.0:1788574505.338061:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681744896 00000100:00100000:3.0:1788574505.338121:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574505.338131:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6674700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+4:23780:x1875455681744896:12345-0@lo:104: 00010000:00010000:3.0:1788574505.338153:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c860217e400/0x5bf8706fdac8d9ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d9f5 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574505.338275:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574505.338282:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6674700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+4:23780:x1875455681744896:12345-0@lo:104: Request processed in 153us (5651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574505.338288:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574505.338330:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788574505.338337:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6676300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+3:23780:x1875455681744768:12345-0@lo:104: 00010000:00010000:0.0:1788574505.338344:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574505.338347:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85faea2600/0x5bf8706fdac8daf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8daf8 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574505.338352:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860217e400/0x5bf8706fdac8d9ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d9f5 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574505.338363:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217e400 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574505.338368:0:22615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860217e400/0x5bf8706fdac8d9ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8d9f5 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574505.338378:0:22615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860217e400/0x5bf8706fdac8d9ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8d9f5 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574505.338382:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:0.0:1788574505.338389:0:22615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860217e400/0x5bf8706fdac8d9ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8d9f5 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574505.338391:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6676300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+3:23780:x1875455681744768:12345-0@lo:104: Request processed in 54us (6029us total) trans 0 rc 0/0 10000000:01000000:0.0:1788574505.338404:0:22615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788574505.338406:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788574505.338444:0:22615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c860217e400/0x5bf8706fdac8d9ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d9f5 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574505.338451:0:22615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574505.338538:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860217e400/0x5bf8706fdac8d9ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d9f5 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.338540:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574505.338551:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860217e400/0x5bf8706fdac8d9ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d9f5 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574505.338581:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574505.338583:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574505.338585:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574505.338596:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574505.338614:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a90d265-af03-4b80-95da-0de9cffed3f2:3617:1875455681745024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574505.338665:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574505.338720:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681745024 00000100:00100000:0.0:1788574505.338724:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681745024 00010000:00010000:1.0:1788574505.338734:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574505.338743:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85faea2600/0x5bf8706fdac8daf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8daf8 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.338752:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2600 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574505.338755:0:22616:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2600/0x5bf8706fdac8daf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8daf8 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.338762:0:22616:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea2600/0x5bf8706fdac8daf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8daf8 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574505.338775:0:22616:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2600/0x5bf8706fdac8daf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8daf8 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574505.338779:0:22616:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788574505.338814:0:22616:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85faea2600/0x5bf8706fdac8daf1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8daf8 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.338820:0:22616:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574505.338837:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2600/0x5bf8706fdac8daf1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8daf8 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.338976:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea2600/0x5bf8706fdac8daf1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8daf8 expref: -99 pid: 23357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.338991:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574505.338992:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574505.338994:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574505.339005:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574505.339015:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681745152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574505.339044:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574505.339082:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681745152 00000100:00100000:1.0:1788574505.339085:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681745152 00010000:00010000:0.0:1788574505.339117:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d9f5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d9ee expref: 19 pid: 22621 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574505.339142:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574505.339150:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+19:3617:x1875455681745024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574505.339162:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574505.339168:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d9f5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d9ee expref: 19 pid: 22621 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574505.339178:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d9f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8d9ee expref: 19 pid: 22621 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574505.339232:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574505.339269:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+19:3617:x1875455681745024:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574505.339276:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574505.339296:0:23780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6676a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23780:1875455681744768:0@lo:104: 00000100:00100000:0.0:1788574505.339318:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a90d265-af03-4b80-95da-0de9cffed3f2:3617:1875455681745024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574505.339321:0:23780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d9f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8d9ee expref: 18 pid: 22621 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574505.339338:0:23780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23780:1875455681744896:0@lo:104: 00010000:00010000:2.0:1788574505.339359:0:23780:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8db4c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574505.339386:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574505.339388:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574505.339488:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8daf8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8daf1 expref: 17 pid: 22622 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574505.339512:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788574505.339519:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a90d265-af03-4b80-95da-0de9cffed3f2+17:3620:x1875455681745152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574505.339528:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574505.339540:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8daf8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8daf1 expref: 17 pid: 22622 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.339548:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8daf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8daf1 expref: 17 pid: 22622 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.339559:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8daf8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8daf1 expref: 17 pid: 22622 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.339569:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8db4c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.339578:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8db4c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.339590:0:22613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8db4c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.339597:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8db4c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.339603:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8db4c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.339609:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8db4c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.339613:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574505.339617:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8db4c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.339623:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8db4c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.339648:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8db4c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574505.339657:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574505.339706:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a90d265-af03-4b80-95da-0de9cffed3f2+16:3620:x1875455681745152:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574505.339713:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788574505.340069:0:23780:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8db4c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574505.340078:0:23780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8db4c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574505.340085:0:23780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8db4c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574505.341087:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681745152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574505.492963:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574505.811927:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788574506.131309:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574496/real 1788574496] req@ffff9c85f6675880 x1875455681740160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574506.131342:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c85f6675880 x1875455681740160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574506.131373:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574496/real 1788574496] req@ffff9c85c8ab0700 x1875455681740032/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574506.131385:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c85c8ab0700 x1875455681740032/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574506 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574506.131402:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c369d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574506.131428:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788574506.131432:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681740160:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788574506.131439:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85c658c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574506.131444:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788574506.131446:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681740032:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788574506.131609:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574506.131614:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574506.131617:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574506.131619:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574506.131633:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574506.131637:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788574506.131639:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85c658c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574506.131644:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 636 00000100:00080000:1.0:1788574506.131650:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788574506.131656:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c85c658c800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574506.131674:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85c8ab2300 x1875455681745792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788574506.131685:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574506.131688:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788574506.131690:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c84c369d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788574506.131694:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681745280:0@lo:400:kworker.0 00000100:00080000:1.0:1788574506.131695:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 636 00000100:00080000:1.0:1788574506.131701:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788574506.131712:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c84c369d800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574506.131776:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574506.131816:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574506.131821:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681745664:0@lo:400:kworker.0 00000100:00100000:3.0:1788574506.131858:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574506.131957:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85c8ab0700 x1875455681745920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574506.132012:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574506.132058:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681745408:0@lo:400:kworker.0 00000100:00100000:2.0:1788574506.132097:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574506.132118:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574506.132123:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681745536:0@lo:400:kworker.0 00000100:00100000:2.0:1788574506.132144:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574506.132183:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681745280 00000100:00100000:2.0:1788574506.132209:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681745280 00000100:00100000:2.0:1788574506.132255:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788574506.132263:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+16:3620:x1875455681745280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574506.132304:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+16:3620:x1875455681745280:12345-0@lo:400:kworker.0 Request processed in 42us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574506.132312:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788574506.132342:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681745664 00000100:00100000:2.0:1788574506.132351:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681745664 00000100:00100000:2.0:1788574506.132373:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681745408 00000100:00100000:2.0:1788574506.132375:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681745408 00000100:00100000:2.0:1788574506.132388:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788574506.132393:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681745664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574506.132424:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681745664:12345-0@lo:400:kworker.0 Request processed in 31us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574506.132430:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788574506.132440:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788574506.132445:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875455681745408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574506.132471:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875455681745408:12345-0@lo:400:kworker.0 Request processed in 26us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574506.132476:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788574506.132494:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681745536 00000100:00100000:2.0:1788574506.132497:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681745536 00000100:00100000:2.0:1788574506.132520:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574506.132526:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681745536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574506.132551:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681745536:12345-0@lo:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574506.132556:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788574506.132587:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85c8ab1880 x1875455681745536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574506.132599:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681745536:0@lo:400:kworker.0 00000100:00100000:2.0:1788574506.132607:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681745408:0@lo:400:kworker.0 00000100:00100000:2.0:1788574506.132628:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681745792:0@lo:8:kworker.0 00000400:00000100:2.0:1788574506.132650:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681745792 offset 0 length 520: 4 00000100:00100000:2.0:1788574506.132668:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681745920:0@lo:8:kworker.0 00000400:00000100:2.0:1788574506.132684:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681745920 offset 0 length 520: 4 00000100:00100000:3.0:1788574506.133073:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681745664:0@lo:400:kworker.0 00000100:00100000:3.0:1788574506.133100:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681745280:0@lo:400:kworker.0 00000100:00100000:0.0:1788574506.137584:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681746048:0@lo:400:kworker.0 00000100:00100000:0.0:1788574506.137665:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574506.137720:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681746048 00000100:00100000:0.0:1788574506.137728:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681746048 00000100:00100000:0.0:1788574506.137774:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574506.137783:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681746048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574506.137850:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681746048:12345-0@lo:400:kworker.0 Request processed in 67us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574506.137857:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788574506.137898:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85c8ab3100 x1875455681746048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574506.137911:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681746048:0@lo:400:kworker.0 10000000:01000000:1.0:1788574506.451622:0:22624:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788574506.451631:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85fa0fa800 from 13 10000000:01000000:1.0:1788574506.451637:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574506.451690:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8db53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574506.451702:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8db53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574506.451724:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8db53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574506.451750:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681746176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574506.451821:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574506.451866:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574506.451997:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681746176 00000100:00100000:2.0:1788574506.452006:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681746176 00000100:00100000:2.0:1788574506.452060:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788574506.452070:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c6e1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+16:22624:x1875455681746176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574506.452082:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574506.452095:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8db5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8db53 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.452117:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8db5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8db53 expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.452126:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8db5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8db53 expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.452134:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32fc00, rc 0) 00000100:00100000:2.0:1788574506.452208:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c6e1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+17:22624:x1875455681746176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574506.452216:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788574506.454471:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681746176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574506.454498:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8db53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db5a expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574506.454510:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8db53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8db5a expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574506.454605:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681746304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574506.454656:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574506.454700:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574506.455494:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681746304 00000100:00100000:2.0:1788574506.455504:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681746304 00000100:00100000:2.0:1788574506.455557:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788574506.455580:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c6e1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+17:22624:x1875455681746304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574506.455734:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c6e1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+17:22624:x1875455681746304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574506.455741:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788574506.456620:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681746304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574506.456687:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681746432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574506.456750:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574506.456788:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574506.459138:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681746432 00000100:00100000:2.0:1788574506.459153:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681746432 00000100:00100000:2.0:1788574506.459237:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788574506.459248:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c6e1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+17:22624:x1875455681746432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574506.460664:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c6e1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+17:22624:x1875455681746432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1410us (3905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574506.460676:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788574506.460855:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681746432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788574506.462208:0:23842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788574506.464534:0:22624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788574506.464580:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574506.464592:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8db53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db5a expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574506.464605:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8db53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db5a expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574506.464614:0:22624:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788574506.464617:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c84c2291800 from 13 10000000:01000000:1.0:1788574506.464620:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574506.464664:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2c00/0x5bf8706fdac8db61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574506.464673:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2c00/0x5bf8706fdac8db61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574506.464684:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2c00/0x5bf8706fdac8db61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574506.464712:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681746560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574506.464790:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574506.464838:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574506.464993:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681746560 00000100:00100000:2.0:1788574506.465003:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681746560 00000100:00100000:2.0:1788574506.465046:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788574506.465055:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c6e1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+17:22624:x1875455681746560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574506.465070:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574506.465086:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8db68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8db61 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.465111:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8db68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8db61 expref: 18 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.465122:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8db68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8db61 expref: 18 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.465131:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e600, rc 0) 00000100:00100000:2.0:1788574506.465181:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c6e1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+18:22624:x1875455681746560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574506.465203:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788574506.465877:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681746560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574506.465896:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2c00/0x5bf8706fdac8db61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db68 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574506.465907:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2c00/0x5bf8706fdac8db61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8db68 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574506.465975:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681746688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574506.466005:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574506.466039:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574506.467692:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681746688 00000100:00100000:2.0:1788574506.467706:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681746688 00000100:00100000:2.0:1788574506.467762:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788574506.467771:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c6e1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+18:22624:x1875455681746688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574506.467937:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c6e1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+18:22624:x1875455681746688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574506.467944:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788574506.468059:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681746688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574506.468107:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681746816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574506.468152:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574506.468221:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574506.469480:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681746816 00000100:00100000:2.0:1788574506.469492:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681746816 00000100:00100000:2.0:1788574506.469534:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788574506.469542:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c6e1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+18:22624:x1875455681746816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574506.469986:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c6e1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+18:22624:x1875455681746816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 442us (1831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574506.469994:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788574506.470130:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681746816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788574506.473933:0:23843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788574506.476059:0:22624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788574506.476099:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574506.476112:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2c00/0x5bf8706fdac8db61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db68 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574506.476126:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2c00/0x5bf8706fdac8db61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db68 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574506.516240:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574507.157877:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681746944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574507.158239:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574507.158301:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681746944 00000100:00100000:0.0:1788574507.158308:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681746944 00000100:00100000:0.0:1788574507.158352:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574507.158360:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875455681746944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574507.158397:0:23367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788574507.158443:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875455681746944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574507.158450:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574507.158499:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681746944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574507.166182:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574507.171400:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681747072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574507.171479:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574507.173520:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681747072 00000100:00100000:1.0:1788574507.173533:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681747072 00000100:00100000:1.0:1788574507.173592:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788574507.173600:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681747072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788574507.173647:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788574507.173732:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681747072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (2251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574507.173739:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788574507.173911:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681747072:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788574507.543807:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574508.179659:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574493/real 1788574493] req@ffff9c85f6674000 x1875455681737984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574508 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574508.179702:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c85f6674000 x1875455681737984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574508 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574508.179713:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574493/real 1788574493] req@ffff9c85f6675500 x1875455681738112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574508 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574508.179725:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c85f6675500 x1875455681738112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574508 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574508.179748:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85d20ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574508.179767:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788574508.179771:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681737984:0@lo:8:kworker.0 00000100:00080000:2.0:1788574508.179777:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85f6de8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574508.179789:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788574508.179792:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681738112:0@lo:8:kworker.0 00000100:00080000:3.0:1788574508.182716:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574508.182723:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788574508.182726:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85d20ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574508.182734:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 633 00000100:00080000:3.0:1788574508.182740:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788574508.182749:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c85d20ea800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574508.182770:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85fb9bea00 x1875455681747456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574508.182790:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574508.182793:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788574508.182795:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85f6de8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574508.182799:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 633 00000100:00080000:3.0:1788574508.182802:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788574508.182806:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c85f6de8000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574508.182818:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85fb9bd500 x1875455681747584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574508.182847:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574508.182850:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788574508.182853:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574508.182864:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788574508.183051:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681747328:0@lo:400:kworker.0 00000100:00100000:2.0:1788574508.183149:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574508.183214:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788574508.183221:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681747200:0@lo:400:kworker.0 00000100:00100000:2.0:1788574508.183252:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574508.183289:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681747968:0@lo:400:kworker.0 00000100:00100000:2.0:1788574508.183761:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574508.183789:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681747712:0@lo:400:kworker.0 00000100:00100000:2.0:1788574508.183815:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574508.183834:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574508.183839:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681747840:0@lo:400:kworker.0 00000100:00100000:2.0:1788574508.183860:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574508.183888:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681747968 00000100:00100000:2.0:1788574508.183896:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681747968 00000100:00100000:2.0:1788574508.183952:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681747712 00000100:00100000:2.0:1788574508.183956:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681747712 00000100:00100000:2.0:1788574508.183980:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788574508.183989:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681747968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574508.184039:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681747968:12345-0@lo:400:kworker.0 Request processed in 51us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574508.184047:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788574508.184064:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788574508.184070:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681747712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574508.184097:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681747712:12345-0@lo:400:kworker.0 Request processed in 28us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574508.184113:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788574508.184165:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85fb9bf100 x1875455681747712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574508.184180:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681747712:0@lo:400:kworker.0 00010000:00080000:2.0:1788574508.184294:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85fb9be680 x1875455681747968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574508.184317:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681747968:0@lo:400:kworker.0 00000100:00100000:1.0:1788574508.184655:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681747200 00000100:00100000:1.0:1788574508.184661:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681747200 00000100:00100000:1.0:1788574508.184705:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788574508.184713:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c6e1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+18:3620:x1875455681747200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574508.184757:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c6e1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+18:3620:x1875455681747200:12345-0@lo:400:kworker.0 Request processed in 45us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574508.184764:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788574508.184798:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681747328 00000100:00100000:1.0:1788574508.184801:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681747328 00000100:00100000:1.0:1788574508.184823:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681747840 00000100:00100000:1.0:1788574508.184827:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681747840 00000100:00100000:1.0:1788574508.184841:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574508.184847:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681747328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574508.184876:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681747328:12345-0@lo:400:kworker.0 Request processed in 30us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574508.184883:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574508.184893:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788574508.184898:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681747840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574508.184931:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681747840:12345-0@lo:400:kworker.0 Request processed in 32us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574508.184937:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788574508.184980:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681747840:0@lo:400:kworker.0 00000100:00100000:1.0:1788574508.185016:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681747200:0@lo:400:kworker.0 00000100:00100000:1.0:1788574508.185027:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681747328:0@lo:400:kworker.0 00000100:00100000:1.0:1788574508.185090:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681747456:0@lo:8:kworker.0 00000400:00000100:1.0:1788574508.185112:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681747456 offset 0 length 520: 4 00000100:00100000:1.0:1788574508.185153:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681747584:0@lo:8:kworker.0 00000400:00000100:1.0:1788574508.185169:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681747584 offset 0 length 520: 4 00000001:00100000:0.0:1788574508.195369:0:23358:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788574508.568545:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574508.948353:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788574509.597754:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574510.617797:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574511.635428:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574512.275464:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681748096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574512.275548:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574512.275598:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681748224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574512.275633:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574512.275684:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681748096 00000100:00100000:2.0:1788574512.275693:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681748096 00000100:00100000:2.0:1788574512.275742:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681748224 00000100:00100000:2.0:1788574512.275745:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681748224 00000100:00100000:2.0:1788574512.275760:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574512.275769:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681748096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788574512.275807:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788574512.275870:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681748096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574512.275879:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574512.275895:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788574512.275902:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681748224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788574512.275918:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788574512.276422:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681748224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 518us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574512.276432:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788574512.276435:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681748224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574512.277092:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681748096:0@lo:41:osp-pre-1-0.0 00000020:01000004:2.0:1788574512.480890:0:24131:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788574512.480894:0:24131:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788574512.480895:0:24131:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788574512.481017:0:24131:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c84c3ecb000 00000020:01000004:2.0:1788574512.481033:0:24131:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788574512.481047:0:24131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788574512.481076:0:24131:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c84c270cd40) 00000020:00000080:2.0:1788574512.481094:0:24131:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788574512.516301:0:24131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788574512.518057:0:24131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788574512.518568:0:24131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788574512.518844:0:24131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788574512.519030:0:24131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788574512.519265:0:24131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788574512.519459:0:24131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1788574512.520811:0:24131:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788574512.521068:0:24131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788574512.521081:0:24131:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788574512.521093:0:24131:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5bf8706fdac8db76 00000020:01000004:3.0:1788574512.521101:0:24131:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788574512.521122:0:24131:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788574512.521126:0:24131:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788574512.521132:0:24131:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788574512.521137:0:24131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788574512.521148:0:24131:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c84c2324d40) 00000020:00000080:3.0:1788574512.521160:0:24131:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788574512.524017:0:24131:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574512.524384:0:24131:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788574512.524391:0:24131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788574512.528315:0:24131:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788574512.528333:0:24131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788574512.528999:0:24131:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788574512.529007:0:24131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788574512.530807:0:24131:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574512.531022:0:24131:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788574512.531028:0:24131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788574512.531705:0:24131:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788574512.531713:0:24131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788574512.544599:0:24131:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574512.544879:0:24131:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788574512.544886:0:24131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788574512.546500:0:24131:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788574512.546519:0:24131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788574512.547786:0:24131:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788574512.547800:0:24131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788574512.550002:0:24131:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574512.550456:0:24131:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788574512.550463:0:24131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788574512.550963:0:24131:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788574512.550969:0:24131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788574512.577091:0:24131:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574512.577459:0:24131:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788574512.577468:0:24131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788574512.578630:0:24131:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788574512.578646:0:24131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788574512.579034:0:24131:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788574512.579082:0:24131:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788574512.579303:0:24131:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788574512.589135:0:24131:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788574512.589260:0:24131:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788574512.589271:0:24131:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788574512.589272:0:24131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788574512.589274:0:24131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574512.589274:0:24131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574512.589276:0:24131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574512.589277:0:24131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574512.589278:0:24131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788574512.589279:0:24131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574512.589280:0:24131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788574512.589285:0:24131:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788574512.589287:0:24131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788574512.589288:0:24131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788574512.589289:0:24131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574512.589290:0:24131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574512.589291:0:24131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574512.589292:0:24131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574512.589292:0:24131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788574512.589293:0:24131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574512.589294:0:24131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788574512.589322:0:24131:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788574512.589344:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6675f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681748352:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788574512.589423:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574512.589476:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d10e9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788574512.589506:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681748352 00000100:00100000:1.0:1788574512.589516:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681748352 00000100:00100000:1.0:1788574512.589572:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788574512.589583:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+18:24131:x1875455681748352:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788574512.589615:0:22622:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788574512.589618:0:22622:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788574512.589622:0:22622:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788574512.589976:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+18:24131:x1875455681748352:12345-0@lo:253:mount.lustre.0 Request processed in 393us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574512.589986:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788574512.590083:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6675f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681748352:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788574512.590095:0:24131:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788574512.590097:0:24131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788574512.590099:0:24131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788574512.590100:0:24131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574512.590101:0:24131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574512.590102:0:24131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574512.590103:0:24131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574512.590105:0:24131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788574512.590106:0:24131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574512.590107:0:24131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788574512.590126:0:24131:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c84c3ecb000 from lustre-OST0000 10000000:01000000:2.0:1788574512.590154:0:24131:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788574512.590157:0:24131:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788574512.590173:0:24131:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c8600d599c0 local copy 00010000:00010000:2.0:1788574512.590406:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8d931 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d938 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574512.590665:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6675f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681748480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574512.590704:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574512.590744:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e5680b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574512.590805:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681748480 00000100:00100000:1.0:1788574512.590811:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681748480 00000100:00100000:1.0:1788574512.590879:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788574512.590888:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+18:24131:x1875455681748480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574512.591027:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+18:24131:x1875455681748480:12345-0@lo:501:mount.lustre.0 Request processed in 140us (320us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788574512.591042:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788574512.591134:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6675f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681748480:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788574512.591151:0:24131:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788574512.591185:0:24131:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788574512.591263:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8d931 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d938 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.591272:0:24131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8d931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d938 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574512.591301:0:24131:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c84c3ecb000 10000000:01000000:3.0:1788574512.591306:0:24131:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788574512.591311:0:24131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788574512.591314:0:24131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788574512.591319:0:24131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788574512.591322:0:24131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788574512.591349:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8db84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.591357:0:24131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8db84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.591367:0:24131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8db84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574512.591384:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681748608:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788574512.591427:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574512.591568:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788574512.591643:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681748608 00000100:00100000:1.0:1788574512.591648:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681748608 00000100:00100000:1.0:1788574512.591682:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788574512.591690:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+18:24131:x1875455681748608:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574512.591699:0:22619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574512.591711:0:22619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d08a2800/0x5bf8706fdac8db8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8db84 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574512.591734:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d08a2800/0x5bf8706fdac8db8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8db84 expref: 19 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574512.591757:0:22619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d08a2800/0x5bf8706fdac8db8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8db84 expref: 19 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574512.591767:0:22619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a2800, rc 0) 00000100:00100000:1.0:1788574512.591806:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+19:24131:x1875455681748608:12345-0@lo:101:mount.lustre.0 Request processed in 116us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574512.591812:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788574512.592063:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681748608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574512.592078:0:24131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8db84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db8b expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574512.592089:0:24131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8db84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8db8b expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788574512.593648:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1788574512.594692:0:24131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574512.597352:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788574512.597417:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788574512.597435:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788574512.597452:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788574512.597468:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788574512.597490:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788574512.597506:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788574512.597518:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788574512.597532:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1788574512.597563:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1788574512.597577:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1788574512.597588:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1788574512.597691:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1788574512.597699:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1788574512.597826:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681748736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574512.597899:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574512.597956:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788574512.598130:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681748736 00000100:00100000:2.0:1788574512.598148:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681748736 00000100:00100000:2.0:1788574512.598215:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788574512.598226:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+19:24131:x1875455681748736:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574512.598399:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+19:24131:x1875455681748736:12345-0@lo:501:mount.lustre.0 Request processed in 174us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574512.598408:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788574512.599039:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681748736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574512.599106:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681748864:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574512.599165:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574512.599225:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681748864 00000100:00100000:2.0:1788574512.599232:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681748864 00000100:00100000:1.0:1788574512.599245:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788574512.599277:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788574512.599284:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+19:24131:x1875455681748864:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574512.600468:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+19:24131:x1875455681748864:12345-0@lo:503:mount.lustre.0 Request processed in 1178us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574512.600892:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788574512.601020:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681748864:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788574512.601550:0:24131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788574512.601640:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681748992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574512.601704:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574512.601749:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574512.603087:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681748992 00000100:00100000:3.0:1788574512.603102:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681748992 00000100:00100000:3.0:1788574512.603169:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788574512.603179:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+19:24131:x1875455681748992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574512.605243:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+19:24131:x1875455681748992:12345-0@lo:502:mount.lustre.0 Request processed in 2054us (3528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574512.605258:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788574512.605865:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681748992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788574512.606147:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788574512.606183:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788574512.609338:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788574512.609369:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788574512.609384:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788574512.609402:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788574512.609415:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788574512.609428:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788574512.609440:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788574512.609900:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788574512.609917:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788574512.609930:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788574512.609991:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681749120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574512.610091:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574512.610148:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788574512.610224:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681749120 00000100:00100000:2.0:1788574512.610233:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681749120 00000100:00100000:2.0:1788574512.610309:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788574512.610320:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+19:24131:x1875455681749120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574512.610453:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+19:24131:x1875455681749120:12345-0@lo:502:mount.lustre.0 Request processed in 136us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574512.610470:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788574512.610620:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681749120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788574512.610672:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788574512.610681:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788574512.611587:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788574512.611597:0:24148:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788574512.611603:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574512.611606:0:24148:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788574512.611611:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788574512.611628:0:24148:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c84c2323380) 00000020:00000080:3.0:1788574512.611651:0:24148:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788574512.611656:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788574512.611746:0:24148:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c84c3ecb000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788574512.611755:0:24148:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788574512.611762:0:24148:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5bf8706fdac8db99 00010000:00010000:3.0:1788574512.616483:0:24148:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788574512.617084:0:24148:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1788574512.620555:0:24148:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788574512.621783:0:24148:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788574512.621799:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574512.621806:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574512.621808:0:24148:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788574512.621812:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788574512.621814:0:24148:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788574512.621816:0:24148:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788574512.621822:0:24148:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788574512.621824:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788574512.621826:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574512.621827:0:24148:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788574512.621828:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574512.621830:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574512.621831:0:24148:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788574512.621833:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788574512.621835:0:24148:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788574512.621836:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574512.621853:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574512.621856:0:24148:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788574512.621858:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574512.621861:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574512.621862:0:24148:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788574512.621865:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788574512.621891:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574512.621894:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574512.621895:0:24148:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788574512.621898:0:24148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1788574512.622137:0:24131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788574512.622172:0:24131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788574512.622217:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8db84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db8b expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574512.622230:0:24131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8db84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8db8b expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574512.622238:0:24131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c84c3ecb000 from 1 10000000:01000000:1.0:1788574512.622241:0:24131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574512.622281:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3400/0x5bf8706fdac8dba0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574512.622290:0:24131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3400/0x5bf8706fdac8dba0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574512.622301:0:24131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3400/0x5bf8706fdac8dba0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574512.622329:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681749248:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788574512.622416:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574512.622459:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574512.622630:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681749248 00000100:00100000:3.0:1788574512.622638:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681749248 00000100:00100000:3.0:1788574512.622686:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788574512.622696:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+19:24131:x1875455681749248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574512.622709:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574512.622721:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea2a00/0x5bf8706fdac8dba7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8dba0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.622746:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea2a00/0x5bf8706fdac8dba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8dba0 expref: 20 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.622757:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea2a00/0x5bf8706fdac8dba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8dba0 expref: 20 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.622776:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2a00, rc 0) 00000100:00100000:3.0:1788574512.622825:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+20:24131:x1875455681749248:12345-0@lo:101:mount.lustre.0 Request processed in 131us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574512.622833:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788574512.622946:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681749248:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574512.622972:0:24131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3400/0x5bf8706fdac8dba0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dba7 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574512.622983:0:24131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3400/0x5bf8706fdac8dba0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8dba7 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574512.627579:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788574512.628624:0:24131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574512.629005:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788574512.629033:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788574512.629057:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788574512.629071:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788574512.629084:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788574512.629110:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788574512.629126:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788574512.629138:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788574512.629150:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788574512.629163:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788574512.629176:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788574512.629267:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788574512.629274:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788574512.629368:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681749376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574512.629439:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574512.629528:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574512.629587:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681749376 00000100:00100000:3.0:1788574512.629596:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681749376 00000100:00100000:3.0:1788574512.629646:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788574512.629656:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+20:24131:x1875455681749376:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574512.629994:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+20:24131:x1875455681749376:12345-0@lo:501:mount.lustre.0 Request processed in 338us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574512.630003:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788574512.630076:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681749376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574512.630110:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681749504:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574512.630155:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574512.630264:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574512.630302:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681749504 00000100:00100000:3.0:1788574512.630306:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681749504 00000100:00100000:3.0:1788574512.630340:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788574512.630346:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+20:24131:x1875455681749504:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574512.630462:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+20:24131:x1875455681749504:12345-0@lo:503:mount.lustre.0 Request processed in 115us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574512.630474:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788574512.630486:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681749504:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788574512.630821:0:24131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788574512.630879:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681749632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574512.630917:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574512.630941:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574512.630966:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681749632 00000100:00100000:3.0:1788574512.630971:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681749632 00000100:00100000:3.0:1788574512.631005:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788574512.631012:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+20:24131:x1875455681749632:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574512.631101:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+20:24131:x1875455681749632:12345-0@lo:502:mount.lustre.0 Request processed in 89us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574512.631108:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788574512.631182:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681749632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788574512.631719:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788574512.631749:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788574512.631764:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788574512.631777:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788574512.631789:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788574512.631800:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788574512.631811:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788574512.631838:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788574512.631854:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788574512.631868:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788574512.631880:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788574512.631904:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681749760:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574512.631949:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574512.632102:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574512.632181:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681749760 00000100:00100000:3.0:1788574512.632350:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681749760 00000100:00100000:3.0:1788574512.632426:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788574512.632436:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+20:24131:x1875455681749760:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574512.632553:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+20:24131:x1875455681749760:12345-0@lo:502:mount.lustre.0 Request processed in 119us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574512.632560:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788574512.632637:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681749760:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788574512.632684:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788574512.632695:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788574512.633557:0:24152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574512.633569:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574512.633576:0:24152:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788574512.633581:0:24152:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c84c3ecb000 00000020:00000080:1.0:1788574512.633583:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574512.633590:0:24152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574512.633592:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574512.633592:0:24152:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788574512.633603:0:24152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574512.633605:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574512.633606:0:24152:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788574512.633608:0:24152:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c84c3ecb000 00000020:00000080:1.0:1788574512.633609:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574512.633800:0:24152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574512.633805:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574512.633807:0:24152:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788574512.633810:0:24152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574512.633813:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574512.633815:0:24152:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788574512.633818:0:24152:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c84c3ecb000 00000020:00000080:1.0:1788574512.633820:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574512.635059:0:24152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574512.635068:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574512.635070:0:24152:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788574512.635074:0:24152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574512.635077:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574512.635079:0:24152:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788574512.635083:0:24152:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c84c3ecb000 00000020:00000080:1.0:1788574512.635085:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574512.635517:0:24152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574512.635521:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574512.635522:0:24152:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788574512.635524:0:24152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788574512.636533:0:24131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788574512.636583:0:24131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574512.636610:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3400/0x5bf8706fdac8dba0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dba7 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.636623:0:24131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3400/0x5bf8706fdac8dba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dba7 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574512.636683:0:24131:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788574512.636686:0:24131:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c84c3ecb000 10000000:01000000:3.0:1788574512.636689:0:24131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c84c3ecb000 10000000:01000000:3.0:1788574512.636693:0:24131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788574512.636699:0:24131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c84c3ecb000 from 1 10000000:01000000:3.0:1788574512.636701:0:24131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788574512.636753:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8dbae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.636763:0:24131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8dbae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.636778:0:24131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8dbae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574512.636817:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681749888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788574512.636895:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574512.636940:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681749888 00000100:00100000:3.0:1788574512.636947:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681749888 00000100:00100000:3.0:1788574512.636990:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788574512.637000:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+20:24131:x1875455681749888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574512.637014:0:22619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574512.637026:0:22619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea3600/0x5bf8706fdac8dbb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8dbae expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.637391:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea3600/0x5bf8706fdac8dbb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8dbae expref: 21 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.637405:0:22619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea3600/0x5bf8706fdac8dbb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8dbae expref: 21 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.637415:0:22619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3600, rc 0) 00000100:00100000:3.0:1788574512.637456:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24131:x1875455681749888:12345-0@lo:101:mount.lustre.0 Request processed in 457us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574512.637462:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788574512.637520:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85f6f2d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788574512.637543:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681749888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574512.637556:0:24131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8dbae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dbb5 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.637565:0:24131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8dbae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8dbb5 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788574512.639692:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788574512.640000:0:24131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574512.640362:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788574512.640392:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788574512.640411:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788574512.640428:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788574512.640447:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788574512.640462:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788574512.640476:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788574512.640492:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788574512.640513:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788574512.640529:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788574512.640549:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788574512.640570:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788574512.640588:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788574512.640605:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788574512.640629:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788574512.640648:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788574512.640667:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788574512.640684:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788574512.640705:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788574512.640720:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788574512.640736:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788574512.640755:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788574512.640774:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788574512.640814:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788574512.640842:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788574512.640866:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788574512.640886:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788574512.640911:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788574512.640930:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788574512.640948:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788574512.640981:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788574512.641001:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788574512.641023:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788574512.641057:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788574512.641077:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788574512.641092:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788574512.641105:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788574512.641119:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788574512.641136:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788574512.641420:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788574512.641447:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788574512.641471:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788574512.641491:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788574512.641510:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788574512.641528:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788574512.641549:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788574512.641571:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788574512.641591:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788574512.641808:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788574512.641851:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788574512.641878:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788574512.641887:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788574512.642015:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681750016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574512.642111:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574512.642314:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e5680b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788574512.643251:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681750016 00000100:00100000:3.0:1788574512.643262:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681750016 00000100:00100000:3.0:1788574512.643327:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788574512.643337:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24131:x1875455681750016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574512.643503:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24131:x1875455681750016:12345-0@lo:501:mount.lustre.0 Request processed in 168us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574512.643510:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788574512.643518:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681750016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574512.643564:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681750144:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574512.643607:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574512.643644:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e5680b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788574512.643659:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681750144 00000100:00100000:3.0:1788574512.643664:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681750144 00000100:00100000:3.0:1788574512.643700:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788574512.643707:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24131:x1875455681750144:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574512.643789:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24131:x1875455681750144:12345-0@lo:503:mount.lustre.0 Request processed in 83us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574512.643797:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788574512.643797:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681750144:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788574512.644233:0:24131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788574512.644321:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681750272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574512.644362:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574512.644612:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d10e9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788574512.644701:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681750272 00000100:00100000:0.0:1788574512.644709:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681750272 00000100:00100000:0.0:1788574512.644756:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788574512.644765:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24131:x1875455681750272:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574512.644863:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24131:x1875455681750272:12345-0@lo:502:mount.lustre.0 Request processed in 100us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574512.644871:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788574512.644880:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681750272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574512.645121:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788574512.645149:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788574512.645163:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788574512.645175:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788574512.645223:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788574512.645243:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788574512.645258:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788574512.645274:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788574512.645292:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788574512.645311:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788574512.645329:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788574512.645343:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788574512.645357:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788574512.645370:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788574512.645404:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788574512.645428:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788574512.645448:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788574512.645469:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788574512.645508:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788574512.645530:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788574512.645551:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788574512.645567:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788574512.645584:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788574512.645722:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788574512.645745:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788574512.645768:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788574512.645781:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788574512.645796:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788574512.645809:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788574512.645824:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788574512.645851:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788574512.645867:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788574512.645879:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788574512.645893:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788574512.645906:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788574512.645921:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788574512.645938:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788574512.645955:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788574512.645971:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788574512.645987:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788574512.646001:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788574512.646016:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788574512.646032:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788574512.646058:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788574512.646075:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788574512.646089:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788574512.646115:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788574512.646128:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788574512.646171:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681750400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574512.646253:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574512.646293:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e5680b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574512.646348:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681750400 00000100:00100000:1.0:1788574512.646356:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681750400 00000100:00100000:1.0:1788574512.646400:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788574512.646420:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24131:x1875455681750400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574512.646543:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24131:x1875455681750400:12345-0@lo:502:mount.lustre.0 Request processed in 126us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574512.646553:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788574512.646572:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681750400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574512.646798:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788574512.646822:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788574512.646845:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681750528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574512.646891:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574512.646915:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d10e9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788574512.647447:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681750528 00000100:00100000:1.0:1788574512.647455:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681750528 00000100:00100000:1.0:1788574512.647504:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788574512.647515:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85cca03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24131:x1875455681750528:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574512.647619:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85cca03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24131:x1875455681750528:12345-0@lo:502:mount.lustre.0 Request processed in 106us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574512.647627:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788574512.647690:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681750528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574512.647739:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788574512.647748:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788574512.649332:0:24157:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788574512.649353:0:24157:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c85fa0b8000) 00000020:00000080:0.0:1788574512.649377:0:24157:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788574512.649478:0:24157:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c84c3ecb000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788574512.649483:0:24157:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c84c3ecb000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788574512.649486:0:24157:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c84c3ecb000 3 00010000:00080000:0.0:1788574512.649521:0:24157:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85f7414800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1788574512.651428:0:24157:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788574512.651674:0:24157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788574512.651718:0:24157:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788574512.651737:0:24157:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5bf8706fdac8dbc3 00000100:00080000:0.0:1788574512.651749:0:24157:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574512.651755:0:24157:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c85f7414800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574512.651791:0:24157:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85fb9b4700 x1875455681750656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574512.651836:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875455681750656:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788574512.651911:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574512.651957:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681750656 00000100:00100000:2.0:1788574512.651968:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681750656 00000100:00100000:2.0:1788574512.652001:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574512.652009:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875455681750656:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788574512.652034:0:22627:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:2.0:1788574512.652082:0:22627:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5bf8706fdac8dbca 00000004:00100000:2.0:1788574512.652495:0:22627:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788574512.652533:0:22627:0:(import.c:65:import_set_state_nolock()) ffff9c85faf2b800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788574512.652538:0:24157:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788574512.652594:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875455681750656:12345-0@lo:38:llog_process_th.0 Request processed in 584us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574512.652679:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788574512.652714:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574512.652718:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574512.652721:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574512.652725:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574512.652757:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574512.652760:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574512.652762:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574512.652766:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788574512.652817:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681750784:0@lo:400:kworker.0 00000100:00100000:2.0:1788574512.652823:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681750912:0@lo:400:kworker.0 00000100:00100000:2.0:1788574512.652862:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574512.652912:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681750912 00000100:00100000:2.0:1788574512.652917:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681750912 00000100:00100000:2.0:1788574512.652952:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574512.652962:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681750912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574512.652969:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574512.653013:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681750912:12345-0@lo:400:kworker.0 Request processed in 54us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574512.653021:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574512.653035:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681750784 00000100:00100000:2.0:1788574512.653039:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681750784 00000100:00100000:2.0:1788574512.653079:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788574512.653087:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681750784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574512.653125:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681750784:12345-0@lo:400:kworker.0 Request processed in 40us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574512.653133:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788574512.653167:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85f6677b80 x1875455681750784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788574512.653174:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85f6675f80 x1875455681750912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574512.653209:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681750784:0@lo:400:kworker.0 00000100:00100000:2.0:1788574512.653212:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681750912:0@lo:400:kworker.0 00010000:00080000:2.0:1788574512.653514:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85fb9b4700 x1875455681750656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574512.653524:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788574512.653531:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788574512.653539:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788574512.653544:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788574512.653553:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85f7414800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788574512.653559:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875455681750656:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1788574512.654365:0:24157:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788574512.654381:0:24157:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c85fa0bcd40) 00000020:00000080:0.0:1788574512.654402:0:24157:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1788574512.654475:0:24157:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c84c3ecb000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788574512.654480:0:24157:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c84c3ecb000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788574512.654482:0:24157:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c84c3ecb000 3 00010000:00080000:0.0:1788574512.654511:0:24157:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85f7411800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1788574512.656450:0:24157:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788574512.656656:0:24157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788574512.656700:0:24157:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788574512.656715:0:24157:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5bf8706fdac8dbd8 00000100:00080000:0.0:1788574512.656726:0:24157:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574512.656733:0:24157:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c85f7411800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574512.656773:0:24157:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85fb9b7100 x1875455681751040/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788574512.656807:0:24157:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788574512.657041:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1875455681751040:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788574512.657127:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788574512.657226:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574512.657232:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574512.657235:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574512.657318:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574512.657322:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574512.657325:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574512.657328:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574512.657331:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788574512.657352:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681751040 00000100:00100000:2.0:1788574512.657359:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681751040 00000100:00100000:2.0:1788574512.657451:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574512.657460:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875455681751040:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788574512.657485:0:22628:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:2.0:1788574512.657528:0:22628:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5bf8706fdac8dbdf 00000004:00100000:2.0:1788574512.657543:0:22628:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788574512.657573:0:22628:0:(import.c:65:import_set_state_nolock()) ffff9c85faf2d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574512.657631:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875455681751040:12345-0@lo:38:llog_process_th.0 Request processed in 170us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574512.657638:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788574512.657704:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85fb9b7100 x1875455681751040/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574512.657714:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788574512.657722:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788574512.657728:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788574512.657733:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788574512.657735:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85f7411800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788574512.657740:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1875455681751040:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788574512.658901:0:24157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788574512.659039:0:24131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788574512.659085:0:24131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788574512.659151:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8dbae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dbb5 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574512.659160:0:24131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8dbae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dbb5 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788574512.659221:0:24131:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788574512.659223:0:24131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788574512.659224:0:24131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574512.659225:0:24131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574512.659227:0:24131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574512.659228:0:24131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574512.659229:0:24131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574512.659231:0:24131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574512.659232:0:24131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788574512.659238:0:24131:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788574512.659240:0:24131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788574512.659246:0:24131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788574512.659247:0:24131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574512.659248:0:24131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574512.659249:0:24131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574512.659250:0:24131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574512.659251:0:24131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574512.659252:0:24131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574512.659253:0:24131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788574512.659278:0:24131:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788574512.659296:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681751168:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788574512.659354:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574512.659390:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788574512.659414:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681751168 00000100:00100000:1.0:1788574512.659420:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681751168 00000100:00100000:1.0:1788574512.659462:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788574512.659469:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85cca03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24131:x1875455681751168:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788574512.659497:0:22622:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788574512.659512:0:22622:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1788574512.660733:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1788574512.662898:0:22622:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788574512.662950:0:22622:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788574512.663485:0:22643:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788574512.663491:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788574512.663518:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8dbe6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.663539:0:22643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85faea3200/0x5bf8706fdac8db30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8db29 expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.663548:0:22643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8db3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8db37 expref: 21 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.663568:0:22643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8dbe6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.663701:0:22643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8db3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8db37 expref: 21 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.663716:0:22643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8db3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8db37 expref: 21 pid: 22619 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574512.663742:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22643:1875455681751296:0@lo:104: 00000100:00100000:3.0:1788574512.663815:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574512.663869:0:22643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85faea3200/0x5bf8706fdac8db30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8db29 expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.663877:0:22643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85faea3200/0x5bf8706fdac8db30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8db29 expref: 21 pid: 22621 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574512.663885:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22643:1875455681751424:0@lo:104: 00000100:00100000:3.0:1788574512.663908:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574512.663923:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85f6f2d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788574512.663951:0:22611:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788574512.664117:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681751296 00000100:00100000:3.0:1788574512.664123:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681751296 00000100:00100000:3.0:1788574512.664155:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681751424 00000100:00100000:3.0:1788574512.664158:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681751424 00000100:00100000:3.0:1788574512.664171:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574512.664178:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a90d265-af03-4b80-95da-0de9cffed3f2+4:22643:x1875455681751296:12345-0@lo:104: 00010000:00010000:3.0:1788574512.664313:0:22611:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8db37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8db3e expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.664374:0:22611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574512.664379:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a90d265-af03-4b80-95da-0de9cffed3f2+4:22643:x1875455681751296:12345-0@lo:104: Request processed in 202us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574512.664387:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574512.664403:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574512.664409:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5889050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a90d265-af03-4b80-95da-0de9cffed3f2+3:22643:x1875455681751424:12345-0@lo:104: 00010000:00010000:3.0:1788574512.664417:0:22611:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85faea3000/0x5bf8706fdac8db29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8db30 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.664496:0:22611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788574512.664502:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5889050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a90d265-af03-4b80-95da-0de9cffed3f2+3:22643:x1875455681751424:12345-0@lo:104: Request processed in 94us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574512.664509:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788574512.664637:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85cca03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24131:x1875455681751168:12345-0@lo:253:mount.lustre.0 Request processed in 5167us (5281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574512.664646:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:1.0:1788574512.664798:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574512.664806:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8db37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8db3e expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574512.664813:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a3c00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574512.664817:0:22615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8db37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8db3e expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574512.664827:0:22615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8db37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8db3e expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574512.664835:0:22615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8db37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8db3e expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574512.664846:0:22615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788574512.664914:0:22615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8db37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8db3e expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574512.664920:0:22615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574512.664946:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8db37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8db3e expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574512.664952:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8db37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8db3e expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574512.664958:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681751552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574512.664973:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574512.664976:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85faea3000/0x5bf8706fdac8db29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8db30 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574512.664982:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3000 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574512.664985:0:22615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea3000/0x5bf8706fdac8db29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8db30 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574512.664990:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574512.664992:0:22615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea3000/0x5bf8706fdac8db29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8db30 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574512.664998:0:22615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea3000/0x5bf8706fdac8db29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8db30 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574512.665003:0:22615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788574512.665092:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574512.665133:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22643:1875455681751296:0@lo:104: 00000100:00100000:3.0:1788574512.665142:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22643:1875455681751424:0@lo:104: 00010000:00010000:3.0:1788574512.665160:0:22643:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8dbe6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574512.665345:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681751552 00000100:00100000:0.0:1788574512.665352:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681751552 00010000:00010000:0.0:1788574512.665372:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8db3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8db37 expref: 21 pid: 22619 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574512.665395:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574512.665402:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6677800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:3620:x1875455681751552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574512.665414:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574512.665419:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8db3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8db37 expref: 21 pid: 22619 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574512.665430:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8db3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8db37 expref: 21 pid: 22619 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574512.665456:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8db3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8db37 expref: 21 pid: 22619 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574512.665470:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574512.665550:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6677800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+20:3620:x1875455681751552:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574512.665557:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788574512.665753:0:22615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85faea3000/0x5bf8706fdac8db29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8db30 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574512.665761:0:22615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574512.665789:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85faea3000/0x5bf8706fdac8db29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8db30 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574512.665795:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a90d265-af03-4b80-95da-0de9cffed3f2:3617:1875455681751680:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574512.665797:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea3000/0x5bf8706fdac8db29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8db30 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574512.665811:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574512.665813:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574512.665815:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574512.665825:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574512.665837:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24131:1875455681751168:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788574512.665848:0:24131:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788574512.665852:0:24131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788574512.665854:0:24131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788574512.665856:0:24131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574512.665857:0:24131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574512.665858:0:24131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574512.665860:0:24131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574512.665861:0:24131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574512.665863:0:24131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:2.0:1788574512.665865:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681751680 00000020:01000004:1.0:1788574512.665865:0:24131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788574512.665870:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681751680 00000020:02000000:1.0:1788574512.665876:0:24131:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788574512.665883:0:22614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85faea3200/0x5bf8706fdac8db30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8db29 expref: 20 pid: 22621 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574512.665901:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788574512.665907:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3265850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a90d265-af03-4b80-95da-0de9cffed3f2+20:3617:x1875455681751680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574512.665915:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574512.665919:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85faea3200/0x5bf8706fdac8db30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8db29 expref: 20 pid: 22621 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574512.665926:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85faea3200/0x5bf8706fdac8db30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8db29 expref: 20 pid: 22621 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574512.665935:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea3200/0x5bf8706fdac8db30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8db29 expref: 20 pid: 22621 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574512.665947:0:22614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8dbe6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574512.665956:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8dbe6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788574512.665972:0:22614:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005426108s 00010000:00010000:2.0:1788574512.665977:0:22614:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8dbe6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574512.665991:0:22614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8dbe6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574512.665997:0:22614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8dbe6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574512.666004:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8dbe6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574512.666009:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574512.666014:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8dbe6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574512.666021:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8dbe6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574512.666035:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8dbe6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574512.666059:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574512.666088:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3265850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a90d265-af03-4b80-95da-0de9cffed3f2+19:3617:x1875455681751680:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574512.666095:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788574512.666141:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a90d265-af03-4b80-95da-0de9cffed3f2:3617:1875455681751680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574512.666749:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681751552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574512.666791:0:22643:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8dbe6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.666799:0:22643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8dbe6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574512.666818:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8dbe6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788574512.668475:0:24131:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788574512.673367:0:24131:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788574512.673379:0:24131:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788574512.673420:0:24131:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788574512.673452:0:24131:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788574512.673472:0:24131:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788574512.673500:0:24131:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788574512.675688:0:24131:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788574512.675973:0:24131:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788574513.683479:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788574513.694250:0:24211:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788574513.694931:0:24211:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788574514.455737:0:22624:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788574514.455745:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85fa0fa800 from 13 10000000:01000000:2.0:1788574514.455751:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788574514.455796:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e200/0x5bf8706fdac8dbed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.455808:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e200/0x5bf8706fdac8dbed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.455820:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e200/0x5bf8706fdac8dbed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574514.455846:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681751808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574514.455915:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574514.455968:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653300 going to sleep for 11 seconds 00000100:00100000:0.0:1788574514.459795:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681751808 00000100:00100000:0.0:1788574514.459813:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681751808 00000100:00100000:0.0:1788574514.459908:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788574514.459919:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+19:22624:x1875455681751808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574514.459938:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574514.459961:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d6200/0x5bf8706fdac8dbf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8dbed expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574514.459995:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d6200/0x5bf8706fdac8dbf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8dbed expref: 20 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574514.460008:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d6200/0x5bf8706fdac8dbf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8dbed expref: 20 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574514.460030:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6200, rc 0) 00000100:00100000:0.0:1788574514.460114:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+20:22624:x1875455681751808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (4198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574514.460122:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788574514.460369:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681751808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574514.460391:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e200/0x5bf8706fdac8dbed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dbf4 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.460402:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e200/0x5bf8706fdac8dbed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8dbf4 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574514.460478:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681751936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788574514.460535:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574514.460557:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653300 going to sleep for 11 seconds 00000100:00100000:0.0:1788574514.462301:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681751936 00000100:00100000:0.0:1788574514.462334:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681751936 00000100:00100000:0.0:1788574514.462400:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788574514.462410:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+20:22624:x1875455681751936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788574514.462435:0:22622:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788574514.462454:0:22622:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788574514.462457:0:22622:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788574514.462716:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+20:22624:x1875455681751936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 306us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574514.462727:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788574514.463113:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681751936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788574514.463237:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788574514.463247:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e200/0x5bf8706fdac8dbed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dbf4 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.463258:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e200/0x5bf8706fdac8dbed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dbf4 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574514.463270:0:22624:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788574514.463273:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c84c2291800 from 13 10000000:01000000:2.0:1788574514.463276:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788574514.463311:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8dbfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.463319:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8dbfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.463329:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8dbfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574514.463350:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681752064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574514.463390:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574514.463415:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653300 going to sleep for 11 seconds 00000100:00100000:2.0:1788574514.463433:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681752064 00000100:00100000:2.0:1788574514.463438:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681752064 00000100:00100000:2.0:1788574514.463471:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788574514.463478:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+20:22624:x1875455681752064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574514.463489:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574514.463717:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8dc02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8dbfb expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.463755:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8dc02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8dbfb expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.463765:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8dc02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8dbfb expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.463774:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32fa00, rc 0) 00000100:00100000:2.0:1788574514.464112:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+21:22624:x1875455681752064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 631us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574514.464120:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788574514.471724:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681752064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574514.471766:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8dbfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dc02 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574514.471781:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8dbfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8dc02 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574514.471876:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681752192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788574514.471947:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574514.471998:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa319780 going to sleep for 11 seconds 00000100:00100000:1.0:1788574514.472166:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681752192 00000100:00100000:1.0:1788574514.472174:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681752192 00000100:00100000:1.0:1788574514.472241:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788574514.472252:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:22624:x1875455681752192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788574514.472279:0:22619:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788574514.472300:0:22619:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788574514.472304:0:22619:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788574514.472396:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:22624:x1875455681752192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574514.472404:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788574514.472444:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681752192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788574514.472499:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788574514.477387:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8dbfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dc02 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574514.477407:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8dbfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dc02 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.708727:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788574515.029032:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788574515.731309:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574516.764807:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574517.395744:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574517.395795:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574517.395811:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681752448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574517.395844:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681752320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574517.396422:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574517.397830:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681752320 00000100:00100000:1.0:1788574517.397845:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681752320 00000100:00100000:1.0:1788574517.397913:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788574517.397923:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681752320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788574517.397973:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788574517.398054:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681752320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574517.398060:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788574517.398173:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681752320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574517.400726:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574517.401008:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681752448 00000100:00100000:0.0:1788574517.401019:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681752448 00000100:00100000:0.0:1788574517.401081:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788574517.401091:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681752448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574517.401141:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788574517.401246:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681752448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574517.401255:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574517.401889:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681752448:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788574517.793687:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788574517.907429:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574517.907436:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574517.907439:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574517.907442:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574517.907474:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574517.907477:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574517.907480:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574517.907483:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788574517.907560:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681752576:0@lo:400:kworker.0 00000100:00100000:1.0:1788574517.907628:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574517.907681:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681753088:0@lo:400:kworker.0 00000100:00100000:1.0:1788574517.907714:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574517.907747:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574517.907753:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681752960:0@lo:400:kworker.0 00000100:00100000:1.0:1788574517.907788:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574517.907810:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681752832:0@lo:400:kworker.0 00000100:00100000:1.0:1788574517.907832:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574517.907849:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574517.907853:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681752704:0@lo:400:kworker.0 00000100:00100000:1.0:1788574517.907873:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574517.907900:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681753088 00000100:00100000:1.0:1788574517.907908:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681753088 00000100:00100000:1.0:1788574517.907969:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681752960 00000100:00100000:1.0:1788574517.907973:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681752960 00000100:00100000:1.0:1788574517.908001:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681752832 00000100:00100000:1.0:1788574517.908004:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681752832 00000100:00100000:1.0:1788574517.908015:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681752704 00000100:00100000:1.0:1788574517.908018:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681752704 00000100:00100000:1.0:1788574517.908032:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574517.908039:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681753088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574517.908088:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681753088:12345-0@lo:400:kworker.0 Request processed in 50us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574517.908108:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574517.908125:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574517.908131:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681752960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574517.908158:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681752960:12345-0@lo:400:kworker.0 Request processed in 28us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574517.908164:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574517.908174:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788574517.908179:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681752832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574517.908239:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681752832:12345-0@lo:400:kworker.0 Request processed in 59us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574517.908245:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788574517.908274:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788574517.908280:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681752704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574517.908307:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681752704:12345-0@lo:400:kworker.0 Request processed in 27us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574517.908313:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788574517.908349:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85c8ab1c00 x1875455681752704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574517.908374:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681752704:0@lo:400:kworker.0 00010000:00080000:1.0:1788574517.908386:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85c8ab3800 x1875455681752832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574517.908393:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681752832:0@lo:400:kworker.0 00010000:00080000:1.0:1788574517.908423:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85c8ab1880 x1875455681752960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574517.908431:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681752960:0@lo:400:kworker.0 00010000:00080000:1.0:1788574517.908440:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85c8ab3100 x1875455681753088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574517.908447:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681753088:0@lo:400:kworker.0 00000100:00100000:2.0:1788574517.912003:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681752576 00000100:00100000:2.0:1788574517.912019:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681752576 00000100:00100000:2.0:1788574517.912084:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788574517.912104:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+21:3620:x1875455681752576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574517.912213:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+21:3620:x1875455681752576:12345-0@lo:400:kworker.0 Request processed in 111us (4584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574517.912221:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788574517.912287:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681752576:0@lo:400:kworker.0 00000100:00080000:0.0:1788574517.913624:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574517.913632:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1788574518.164166:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788574518.811278:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788574519.583811:0:24502:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788574519.829211:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788574520.659041:0:24554:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788574520.662425:0:24554:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788574520.856245:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788574521.708962:0:24604:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788574521.709238:0:24604:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788574521.881265:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574506/real 1788574506] req@ffff9c85c8ab2300 x1875455681745792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574521.881297:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c85c8ab2300 x1875455681745792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574521.881307:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574506/real 1788574506] req@ffff9c85c8ab0700 x1875455681745920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574521.881318:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c85c8ab0700 x1875455681745920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574521 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788574521.881358:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85c658c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574521.881380:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788574521.881384:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681745792:0@lo:8:kworker.0 00000100:00080000:1.0:1788574521.881389:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c369d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574521.881394:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788574521.881396:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681745920:0@lo:8:kworker.0 00010000:00010000:1.0:1788574521.881473:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788574521.883483:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574521.883490:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788574521.883493:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574521.883496:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788574521.883524:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574521.883528:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788574521.883531:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85c658c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574521.883536:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 646 00000100:00100000:0.0:1788574521.883536:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681753472:0@lo:400:kworker.0 00000100:00080000:3.0:1788574521.883543:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788574521.883548:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c85c658c800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574521.883568:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85fb9bed80 x1875455681753728/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574521.883580:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574521.883583:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788574521.883589:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c84c369d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574521.883592:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 646 00000100:00080000:3.0:1788574521.883595:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788574521.883598:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c84c369d800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574521.883601:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574521.883608:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85fb9be680 x1875455681753856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574521.883652:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681754240:0@lo:400:kworker.0 00000100:00100000:0.0:1788574521.883674:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574521.883691:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574521.883696:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681753600:0@lo:400:kworker.0 00000100:00100000:0.0:1788574521.883726:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574521.883741:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a90d265-af03-4b80-95da-0de9cffed3f2:3617:1875455681753216:0@lo:400:kworker.0 00000100:00100000:3.0:1788574521.883771:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574521.883795:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681753984:0@lo:400:kworker.0 00000100:00100000:3.0:1788574521.883820:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574521.883836:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788574521.883836:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681753472 00000100:00100000:3.0:1788574521.883841:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681753344:0@lo:400:kworker.0 00000100:00100000:0.0:1788574521.883844:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681753472 00000100:00100000:3.0:1788574521.883861:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574521.883889:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681754112:0@lo:400:kworker.0 00000100:00100000:0.0:1788574521.883893:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681754240 00000100:00100000:0.0:1788574521.883897:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681754240 00000100:00100000:3.0:1788574521.883912:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574521.883919:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681753984 00000100:00100000:0.0:1788574521.883921:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681753984 00000100:00100000:0.0:1788574521.883932:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681754112 00000100:00100000:0.0:1788574521.885302:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681754112 00000100:00100000:0.0:1788574521.885349:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574521.885357:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681753472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574521.885430:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681753472:12345-0@lo:400:kworker.0 Request processed in 72us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574521.885436:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574521.885451:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788574521.885458:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681754240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574521.885483:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681754240:12345-0@lo:400:kworker.0 Request processed in 27us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574521.885488:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788574521.885499:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574521.885503:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681753984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574521.885534:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681753984:12345-0@lo:400:kworker.0 Request processed in 31us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574521.885540:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574521.885550:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574521.885555:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681754112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574521.885578:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681754112:12345-0@lo:400:kworker.0 Request processed in 23us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574521.885590:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574521.885618:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681753600 00000100:00100000:0.0:1788574521.885622:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681753600 00000100:00100000:0.0:1788574521.885642:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681753344 00000100:00100000:0.0:1788574521.885645:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681753344 00000100:00100000:0.0:1788574521.885658:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574521.885663:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681753600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574521.885696:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681753600:12345-0@lo:400:kworker.0 Request processed in 32us (1969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574521.885701:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574521.885712:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788574521.885718:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681753344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574521.885750:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681753344:12345-0@lo:400:kworker.0 Request processed in 33us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574521.885756:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788574521.885991:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681753216 00000100:00100000:1.0:1788574521.885996:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681753216 00000100:00100000:1.0:1788574521.886041:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788574521.886049:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+21:3617:x1875455681753216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574521.886086:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+21:3617:x1875455681753216:12345-0@lo:400:kworker.0 Request processed in 38us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574521.886092:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788574521.886133:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681753728:0@lo:8:kworker.0 00000100:00100000:1.0:1788574521.886171:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574521.886228:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681753856:0@lo:8:kworker.0 00000100:00100000:1.0:1788574521.886257:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574521.886440:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681753728 00000100:00100000:2.0:1788574521.886445:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681753728 00000100:00100000:2.0:1788574521.886473:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681753856 00000100:00100000:2.0:1788574521.886477:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681753856 00000100:00100000:2.0:1788574521.886489:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574521.886494:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875455681753728:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788574521.886521:0:24136:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 661 last 0 00000020:00000080:2.0:1788574521.886550:0:24136:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8dc09 00002000:00100000:2.0:1788574521.886564:0:24136:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c85faf2c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788574521.886568:0:24136:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788574521.886571:0:24136:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788574521.886734:0:24136:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788574521.886758:0:24136:0:(import.c:65:import_set_state_nolock()) ffff9c85faf29000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574521.886815:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1875455681753728:12345-0@lo:8:kworker.0 Request processed in 320us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574521.886822:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574521.886834:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574521.886840:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875455681753856:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788574521.886851:0:24136:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788574521.886933:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574521.886938:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788574521.887124:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681753344:0@lo:400:kworker.0 00010000:00080000:0.0:1788574521.887141:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fb9bdc00 x1875455681754112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574521.887152:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681754112:0@lo:400:kworker.0 00000100:00100000:0.0:1788574521.887163:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a90d265-af03-4b80-95da-0de9cffed3f2:3617:1875455681753216:0@lo:400:kworker.0 00010000:00080000:0.0:1788574521.887174:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fb9bf100 x1875455681753984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574521.887182:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681753984:0@lo:400:kworker.0 00000100:00100000:0.0:1788574521.887253:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681753600:0@lo:400:kworker.0 00010000:00080000:0.0:1788574521.887265:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c3c0ad80 x1875455681754240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574521.887274:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681754240:0@lo:400:kworker.0 00010000:00080000:0.0:1788574521.887284:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fb9be300 x1875455681753472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574521.887293:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681753472:0@lo:400:kworker.0 00010000:00080000:1.0:1788574521.888542:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fb9bed80 x1875455681753728/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574521.888556:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574521.888565:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788574521.888573:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788574521.888579:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788574521.888597:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85c658c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788574521.888632:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788574521.888638:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681753728:0@lo:8:kworker.0 00000004:00080000:0.0:1788574521.890407:0:23369:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788574521.890448:0:23369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23369:1875455681754496:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788574521.890522:0:23369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574521.890552:0:23369:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0f46000 going to sleep for 11 seconds 00000100:00100000:0.0:1788574521.890577:0:24138:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788574521.890584:0:24138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788574521.890671:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574521.890684:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681754368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574521.890712:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574521.891333:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681754496 00000100:00100000:0.0:1788574521.891340:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681754496 00000100:00080000:1.0:1788574521.891487:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574521.891572:0:24616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574521.891581:0:24616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23369:x1875455681754496:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788574521.892941:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681754368 00000100:00100000:3.0:1788574521.892952:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681754368 00000100:00100000:3.0:1788574521.892999:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574521.893007:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3619:x1875455681754368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788574521.893034:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788574521.893112:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3619:x1875455681754368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (2399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574521.893120:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788574521.895396:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fb9b4000 x1875455681754368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574521.895437:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681754368:0@lo:13:osp-pre-0-1.0 00002000:00080000:0.0:1788574521.902150:0:24616:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788574521.902175:0:24616:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788574521.903308:0:24616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23369:x1875455681754496:12345-0@lo:7:osp-pre-0-1.0 Request processed in 11720us (12778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574521.903323:0:24616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788574521.903387:0:23369:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fb9b6680 x1875455681754496/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788574537 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574521.903402:0:23369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23369:1875455681754496:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788574521.903416:0:23369:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788574521.903470:0:23369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9be300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23369:1875455681754624:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788574521.903502:0:23369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574521.903525:0:23369:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0f46000 going to sleep for 11 seconds 00000100:00100000:0.0:1788574521.903543:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681754624 00000100:00100000:0.0:1788574521.903549:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681754624 00000100:00100000:0.0:1788574521.903586:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574521.903594:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23369:x1875455681754624:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788574521.903634:0:24138:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788574521.903664:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23369:x1875455681754624:12345-0@lo:5:osp-pre-0-1.0 Request processed in 71us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574521.903671:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788574521.903694:0:23369:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fb9be300 x1875455681754624/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574537 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574521.903703:0:23369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9be300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23369:1875455681754624:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788574521.903711:0:23369:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788574521.903732:0:23369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9be300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23369:1875455681754752:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788574521.903753:0:23369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574521.903772:0:23369:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0f46000 going to sleep for 11 seconds 00000100:00100000:0.0:1788574521.903783:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681754752 00000100:00100000:0.0:1788574521.903787:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681754752 00000100:00100000:0.0:1788574521.903803:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574521.903808:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23369:x1875455681754752:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788574521.903833:0:24138:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000004:00080000:1.0:1788574521.921255:0:23368:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788574521.921360:0:23368:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 661901169129ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788574521.921367:0:23368:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788574521.921611:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875455681753856:12345-0@lo:8:kworker.0 Request processed in 34763us (35347us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788574521.921628:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788574521.921681:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c369d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574521.921686:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788574521.921690:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681753856:0@lo:8:kworker.0 00000004:00080000:1.0:1788574521.925342:0:23358:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:00080000:0.0:1788574521.952997:0:24132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1788574521.953015:0:24132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788574521.953251:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23369:x1875455681754752:12345-0@lo:5:osp-pre-0-1.0 Request processed in 49436us (49491us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788574521.953262:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788574521.953777:0:23369:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fb9be300 x1875455681754752/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574537 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574521.953790:0:23369:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788574521.953796:0:23369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9be300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23369:1875455681754752:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788574521.953813:0:23369:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1788574521.953862:0:23369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9be300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23369:1875455681754880:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788574521.953910:0:23369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574521.953943:0:23369:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0f46000 going to sleep for 11 seconds 00000100:00100000:1.0:1788574521.954122:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681754880 00000100:00100000:1.0:1788574521.954130:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681754880 00000100:00100000:1.0:1788574521.954182:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574521.954211:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23369:x1875455681754880:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788574521.954262:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23369:x1875455681754880:12345-0@lo:900:osp-pre-0-1.0 Request processed in 53us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574521.954268:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788574521.954295:0:23369:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fb9be300 x1875455681754880/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788574537 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574521.954306:0:23369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9be300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23369:1875455681754880:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788574522.515310:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574522.515334:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681755008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574522.515435:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574522.515503:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681755008 00000100:00100000:3.0:1788574522.515518:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681755008 00000100:00100000:3.0:1788574522.515569:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788574522.515578:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681755008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788574522.515612:0:23367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788574522.515658:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681755008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574522.515665:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788574522.515714:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681755008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574522.524733:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574522.524757:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681755136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574522.524844:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574522.524997:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681755136 00000100:00100000:3.0:1788574522.525006:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681755136 00000100:00100000:3.0:1788574522.525062:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788574522.525071:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681755136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574522.525107:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788574522.525161:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681755136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574522.525168:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788574522.525246:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681755136:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788574522.902682:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574523.923385:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574524.949801:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574525.268109:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788574525.976934:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574526.995325:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574527.123755:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574527.123763:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574527.123776:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574527.123779:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574527.123836:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574527.123840:0:470:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788574527.123844:0:470:0:(import.c:65:import_set_state_nolock()) ffff9c84c369d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574527.123852:0:470:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 661 00000100:00080000:2.0:1788574527.123858:0:470:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788574527.123866:0:470:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c84c369d800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574527.123901:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85f6677b80 x1875455681755904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574527.123960:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681755520:0@lo:400:kworker.0 00000100:00100000:2.0:1788574527.124033:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574527.124495:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681756160:0@lo:400:kworker.0 00000100:00100000:2.0:1788574527.124526:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574527.124577:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788574527.124584:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681755648:0@lo:400:kworker.0 00000100:00100000:2.0:1788574527.124610:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574527.124635:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681756288:0@lo:400:kworker.0 00000100:00100000:2.0:1788574527.124655:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574527.124701:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681755520 00000100:00100000:2.0:1788574527.124709:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681755520 00000100:00100000:2.0:1788574527.124751:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681756160 00000100:00100000:2.0:1788574527.124755:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681756160 00000100:00100000:2.0:1788574527.124793:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681756288 00000100:00100000:2.0:1788574527.124796:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681756288 00000100:00100000:2.0:1788574527.124811:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788574527.124819:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681755520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574527.124869:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681755520:12345-0@lo:400:kworker.0 Request processed in 50us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574527.124884:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788574527.125075:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788574527.125082:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681756160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574527.126569:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681756160:12345-0@lo:400:kworker.0 Request processed in 1484us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574527.126579:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788574527.126605:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788574527.126615:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681756288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574527.126645:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681756288:12345-0@lo:400:kworker.0 Request processed in 33us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574527.126652:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788574527.126686:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681755648 00000100:00100000:2.0:1788574527.126705:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681755648 00000100:00100000:2.0:1788574527.126746:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788574527.126754:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681755648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574527.126804:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681755648:12345-0@lo:400:kworker.0 Request processed in 50us (2191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574527.126810:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788574527.126835:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788574527.126840:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574527.126872:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681755904:0@lo:8:kworker.0 00000100:00100000:2.0:1788574527.126919:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574527.127121:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681755648:0@lo:400:kworker.0 00010000:00080000:2.0:1788574527.127138:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2336a00 x1875455681756288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574527.127162:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681756288:0@lo:400:kworker.0 00010000:00080000:2.0:1788574527.127175:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85f6674a80 x1875455681755520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574527.127184:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681755520:0@lo:400:kworker.0 00010000:00080000:2.0:1788574527.127222:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2334e00 x1875455681756160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574527.127230:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681756160:0@lo:400:kworker.0 00000100:00100000:3.0:1788574527.127938:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681755392:0@lo:400:kworker.0 00000100:00100000:3.0:1788574527.127990:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574527.128032:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681756032:0@lo:400:kworker.0 00000100:00100000:3.0:1788574527.128057:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574527.128079:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788574527.128104:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681755264:0@lo:400:kworker.0 00000100:00100000:3.0:1788574527.128135:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574527.128171:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681755776:0@lo:400:kworker.0 00000100:00100000:3.0:1788574527.128215:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574527.128247:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681755264 00000100:00100000:3.0:1788574527.128253:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681755264 00000100:00100000:3.0:1788574527.128289:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788574527.128296:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:3620:x1875455681755264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574527.128340:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:3620:x1875455681755264:12345-0@lo:400:kworker.0 Request processed in 45us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574527.128361:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788574527.128398:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681755904 00000100:00100000:3.0:1788574527.128402:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681755904 00000100:00100000:3.0:1788574527.128414:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681755776 00000100:00100000:3.0:1788574527.128416:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681755776 00000100:00100000:3.0:1788574527.128443:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574527.128449:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681755776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574527.128476:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681755776:12345-0@lo:400:kworker.0 Request processed in 28us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574527.128481:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574527.128491:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574527.128495:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2336300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3616:x1875455681755904:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788574527.128515:0:24137:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788574527.128553:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2336300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3616:x1875455681755904:12345-0@lo:8:kworker.0 Request processed in 56us (1633us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788574527.128559:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574527.128586:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681755264:0@lo:400:kworker.0 00010000:00080000:3.0:1788574527.128597:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85f6676300 x1875455681755776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574527.128615:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681755776:0@lo:400:kworker.0 00000100:00100000:0.0:1788574527.129419:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681756416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574527.129463:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574527.129923:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681755392 00000100:00100000:2.0:1788574527.129931:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681755392 00000100:00100000:2.0:1788574527.129978:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788574527.129987:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681755392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574527.130041:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681755392:12345-0@lo:400:kworker.0 Request processed in 56us (2050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574527.130047:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788574527.130067:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788574527.130525:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c369d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574527.130531:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788574527.130609:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681755904:0@lo:8:kworker.0 00000100:00100000:2.0:1788574527.130639:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681756032 00000100:00100000:2.0:1788574527.130643:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681756032 00000100:00100000:2.0:1788574527.130719:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574527.130727:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681756032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574527.130765:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681756032:12345-0@lo:400:kworker.0 Request processed in 39us (2707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574527.130796:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788574527.130960:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681755392:0@lo:400:kworker.0 00010000:00080000:3.0:1788574527.130974:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2334a80 x1875455681756032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574527.130982:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681756032:0@lo:400:kworker.0 00000100:00100000:3.0:1788574527.131010:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681756416 00000100:00100000:3.0:1788574527.131014:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681756416 00000100:00100000:3.0:1788574527.131045:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574527.131052:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681756416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788574527.131077:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788574527.131136:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681756416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574527.131142:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788574527.131171:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fb9bdc00 x1875455681756416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574527.131203:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681756416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574527.635637:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574527.635660:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681756544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574527.635738:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574527.635842:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681756544 00000100:00100000:2.0:1788574527.635850:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681756544 00000100:00100000:2.0:1788574527.635917:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788574527.635928:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681756544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788574527.635963:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788574527.636013:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681756544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574527.636021:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788574527.636075:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681756544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574527.639651:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574527.646910:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681756672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574527.646996:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574527.647100:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681756672 00000100:00100000:1.0:1788574527.647110:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681756672 00000100:00100000:1.0:1788574527.647168:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788574527.647179:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681756672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788574527.647249:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788574527.647303:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681756672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574527.647323:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788574527.647651:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681756672:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788574528.021334:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574528.148577:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574508/real 1788574508] req@ffff9c85fb9bea00 x1875455681747456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574528 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574528.148609:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c85fb9bea00 x1875455681747456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574528 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574528.148665:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574508/real 1788574508] req@ffff9c85fb9bd500 x1875455681747584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574528 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574528.148680:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c85fb9bd500 x1875455681747584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574528 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788574528.148700:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85d20ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574528.148722:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788574528.148727:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681747456:0@lo:8:kworker.0 00000100:00080000:1.0:1788574528.148733:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85f6de8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574528.148739:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788574528.148741:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681747584:0@lo:8:kworker.0 00000100:00080000:2.0:1788574528.148892:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574528.148897:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788574528.148899:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85d20ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574528.148904:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:2.0:1788574528.148910:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788574528.148916:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c85d20ea800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574528.148933:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c2334700 x1875455681757056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788574528.148953:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574528.148956:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788574528.148964:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85f6de8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574528.148967:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:2.0:1788574528.148969:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788574528.148973:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c85f6de8000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574528.148987:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c2335c00 x1875455681757184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788574528.149011:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574528.149014:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788574528.149016:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c84c369d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574528.149019:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 667 00000100:00080000:2.0:1788574528.149021:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788574528.149025:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c84c369d800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574528.149036:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c2336d80 x1875455681757696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574528.149076:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681756928:0@lo:400:kworker.0 00000100:00100000:2.0:1788574528.149141:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574528.149173:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681757824:0@lo:400:kworker.0 00000100:00100000:0.0:1788574528.149412:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a90d265-af03-4b80-95da-0de9cffed3f2:3618:1875455681756800:0@lo:400:kworker.0 00000100:00100000:0.0:1788574528.149447:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574528.149478:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681757568:0@lo:400:kworker.0 00000100:00100000:0.0:1788574528.149513:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574528.149538:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788574528.149544:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681757440:0@lo:400:kworker.0 00000100:00100000:0.0:1788574528.149566:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574528.149582:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875455681758080:0@lo:400:kworker.0 00000100:00100000:0.0:1788574528.149602:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574528.149631:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681757568 00000100:00100000:0.0:1788574528.149639:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681757568 00000100:00100000:0.0:1788574528.149686:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574528.149695:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681757568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574528.149760:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681757568:12345-0@lo:400:kworker.0 Request processed in 55us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574528.149767:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788574528.149807:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2335500 x1875455681757568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574528.149818:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681757568:0@lo:400:kworker.0 00000100:00100000:2.0:1788574528.149879:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574528.149907:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788574528.149913:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681757312:0@lo:400:kworker.0 00000100:00100000:2.0:1788574528.149934:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574528.150049:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681756928 00000100:00100000:1.0:1788574528.150054:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681756928 00000100:00100000:1.0:1788574528.150078:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681757440 00000100:00100000:1.0:1788574528.150081:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681757440 00000100:00100000:1.0:1788574528.150093:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788574528.150099:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681756928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574528.150164:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681758080 00000100:00100000:0.0:1788574528.150168:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681758080 00000100:00100000:0.0:1788574528.150224:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681757824 00000100:00100000:0.0:1788574528.150227:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681757824 00000100:00100000:0.0:1788574528.150239:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681757312 00000100:00100000:0.0:1788574528.150241:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681757312 00000100:00100000:0.0:1788574528.150252:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788574528.150258:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875455681758080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574528.152055:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788574528.152072:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681757824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574528.152292:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681756928:12345-0@lo:400:kworker.0 Request processed in 2191us (3149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574528.152302:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788574528.152326:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788574528.152333:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681757440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574528.152369:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681757440:12345-0@lo:400:kworker.0 Request processed in 37us (2802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574528.152375:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788574528.153097:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681757952:0@lo:400:kworker.0 00000100:00100000:2.0:1788574528.153146:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574528.153181:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681756928:0@lo:400:kworker.0 00000100:00100000:2.0:1788574528.153242:0:22629:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788574528.153250:0:22629:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788574528.153272:0:23650:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788574528.153278:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681757952 00000100:00100000:2.0:1788574528.153284:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681757952 00000100:00100000:2.0:1788574528.153314:0:23650:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788574528.153321:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788574528.153329:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681757312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574528.153387:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681757312:12345-0@lo:400:kworker.0 Request processed in 57us (3450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574528.153394:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788574528.153409:0:23650:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788574528.153415:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788574528.153421:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681757952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574528.153447:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681757952:12345-0@lo:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574528.153452:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788574528.153541:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2335180 x1875455681757312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574528.153551:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681757312:0@lo:400:kworker.0 00010000:00080000:2.0:1788574528.153562:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2337b80 x1875455681757952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574528.153570:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681757952:0@lo:400:kworker.0 00000100:00100000:0.0:1788574528.153829:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875455681758080:12345-0@lo:400:kworker.0 Request processed in 3568us (4223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574528.153837:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788574528.153882:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681757440:0@lo:400:kworker.0 00010000:00080000:0.0:1788574528.153894:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2335f80 x1875455681758080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574528.153903:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875455681758080:0@lo:400:kworker.0 00000100:00100000:0.0:1788574528.154244:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681757056:0@lo:8:kworker.0 00000100:00100000:0.0:1788574528.154282:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574528.154320:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681757184:0@lo:8:kworker.0 00000100:00100000:0.0:1788574528.154342:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574528.154359:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681757696:0@lo:8:kworker.0 00000100:00100000:0.0:1788574528.154385:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574528.154416:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681757056 00000100:00100000:0.0:1788574528.154421:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681757056 00000100:00100000:0.0:1788574528.154439:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681757184 00000100:00100000:0.0:1788574528.154442:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681757184 00000100:00100000:0.0:1788574528.154449:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681757696 00000100:00100000:0.0:1788574528.154451:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681757696 00000100:00100000:0.0:1788574528.154461:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788574528.154466:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3616:x1875455681757056:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788574528.154493:0:24138:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 668 last 0 00000020:00000080:0.0:1788574528.154522:0:24138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8dc10 00002000:00100000:0.0:1788574528.154536:0:24138:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c85f7412800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788574528.154541:0:24138:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788574528.154544:0:24138:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788574528.154619:0:24138:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788574528.154642:0:24138:0:(import.c:65:import_set_state_nolock()) ffff9c85f7414000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574528.154683:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1875455681757056:12345-0@lo:8:kworker.0 Request processed in 216us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574528.154698:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788574528.154713:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574528.154717:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3616:x1875455681757184:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788574528.154728:0:24138:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788574528.154767:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3616:x1875455681757184:12345-0@lo:8:kworker.0 Request processed in 48us (423us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788574528.154773:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574528.154784:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788574528.154789:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3616:x1875455681757696:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788574528.154797:0:24138:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788574528.154819:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3616:x1875455681757696:12345-0@lo:8:kworker.0 Request processed in 29us (433us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788574528.154825:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788574528.154862:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2334700 x1875455681757056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574528.154871:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788574528.154878:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788574528.154885:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788574528.154890:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788574528.154892:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85d20ea800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788574528.154908:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788574528.154913:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681757056:0@lo:8:kworker.0 00000100:00080000:0.0:1788574528.154924:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85f6de8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574528.154928:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788574528.154937:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681757184:0@lo:8:kworker.0 00000100:00080000:0.0:1788574528.154949:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c369d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574528.154952:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788574528.154955:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681757696:0@lo:8:kworker.0 00000004:00080000:0.0:1788574528.154982:0:22651:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788574528.155048:0:22651:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668134857052ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788574528.155055:0:22651:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788574528.156904:0:22652:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788574528.156929:0:22652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22652:1875455681758336:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788574528.156989:0:22652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574528.157014:0:22652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8a2d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574528.157029:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574528.157039:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681758208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574528.157063:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574528.157097:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681758208 00000100:00100000:1.0:1788574528.157103:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681758208 00000100:00100000:1.0:1788574528.157155:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574528.157164:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875455681758208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574528.157184:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788574528.157256:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875455681758208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574528.157263:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788574528.157283:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788574528.157311:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85faf5d500 x1875455681758208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574528.157329:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681758208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574528.157384:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681756800 00000100:00100000:1.0:1788574528.157388:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681756800 00000100:00100000:1.0:1788574528.157422:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788574528.157429:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+21:3618:x1875455681756800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574528.157464:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+21:3618:x1875455681756800:12345-0@lo:400:kworker.0 Request processed in 35us (8015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574528.157470:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788574528.157613:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681757824:12345-0@lo:400:kworker.0 Request processed in 5545us (7731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574528.157629:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788574528.157664:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2334000 x1875455681757824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574528.157676:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681757824:0@lo:400:kworker.0 00000100:00100000:0.0:1788574528.158418:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681758336 00000100:00100000:0.0:1788574528.158426:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681758336 00000100:00100000:0.0:1788574528.158460:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788574528.158467:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22652:x1875455681758336:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788574528.158912:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a90d265-af03-4b80-95da-0de9cffed3f2:3618:1875455681756800:0@lo:400:kworker.0 00002000:00080000:3.0:1788574528.174414:0:24138:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788574528.174428:0:24138:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:3.0:1788574528.174435:0:24138:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00000004:00080000:0.0:1788574528.184164:0:22607:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788574528.186768:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.186783:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3889995/0x5bf8706fdac8dc17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.186799:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.186803:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.186809:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3889995/0x5bf8706fdac8dc17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.186826:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3889995/0x5bf8706fdac8dc17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.186836:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3889995/0x5bf8706fdac8dc17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.186843:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3889995/0x5bf8706fdac8dc17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.186872:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574528.186975:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574528.186984:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3889995/0x5bf8706fdac8dc17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.186992:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.186996:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3889995/0x5bf8706fdac8dc17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.187006:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3889995/0x5bf8706fdac8dc17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.187025:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3889995/0x5bf8706fdac8dc17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.187043:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3889995/0x5bf8706fdac8dc17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.187061:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.187064:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.187065:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574528.187417:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.187423:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea60adf6/0x5bf8706fdac8dc1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.187432:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.187435:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.187440:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea60adf6/0x5bf8706fdac8dc1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.187449:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea60adf6/0x5bf8706fdac8dc1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.187457:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea60adf6/0x5bf8706fdac8dc1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.187464:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea60adf6/0x5bf8706fdac8dc1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.188054:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574528.188252:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574528.188260:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea60adf6/0x5bf8706fdac8dc1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.188270:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574528.188274:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea60adf6/0x5bf8706fdac8dc1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.188283:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea60adf6/0x5bf8706fdac8dc1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.188303:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea60adf6/0x5bf8706fdac8dc1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.188317:0:23782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea60adf6/0x5bf8706fdac8dc1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.188333:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.188335:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.188336:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574528.188744:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.188763:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074960dfc/0x5bf8706fdac8dc25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.188774:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.188778:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.188784:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074960dfc/0x5bf8706fdac8dc25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.188808:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074960dfc/0x5bf8706fdac8dc25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.188818:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074960dfc/0x5bf8706fdac8dc25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.188825:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074960dfc/0x5bf8706fdac8dc25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.188849:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574528.189259:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574528.189266:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074960dfc/0x5bf8706fdac8dc25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.189285:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574528.189288:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074960dfc/0x5bf8706fdac8dc25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.189295:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074960dfc/0x5bf8706fdac8dc25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.189309:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074960dfc/0x5bf8706fdac8dc25 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.189316:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074960dfc/0x5bf8706fdac8dc25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.189331:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574528.189333:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574528.189334:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574528.190509:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.190521:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8dc2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.190536:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.190549:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.190555:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8dc2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.190773:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8dc2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.190783:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8dc2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.190801:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8dc2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.190825:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574528.191026:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574528.191033:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8dc2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.191042:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3e00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574528.191046:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8dc2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.191056:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8dc2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.191079:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8dc2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.191087:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8dc2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.191104:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574528.191106:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574528.191108:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574528.191522:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.191528:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000871b6422/0x5bf8706fdac8dc33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.191538:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.191697:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.191703:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000871b6422/0x5bf8706fdac8dc33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.191715:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000871b6422/0x5bf8706fdac8dc33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.191724:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000871b6422/0x5bf8706fdac8dc33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.191732:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000871b6422/0x5bf8706fdac8dc33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.191765:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574528.192399:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574528.192406:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000871b6422/0x5bf8706fdac8dc33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574528.192407:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.192413:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089634dfb/0x5bf8706fdac8dc3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.192416:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.192421:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000871b6422/0x5bf8706fdac8dc33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.192425:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.192429:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574528.192430:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000871b6422/0x5bf8706fdac8dc33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.192434:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089634dfb/0x5bf8706fdac8dc3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.192442:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089634dfb/0x5bf8706fdac8dc3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.192445:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000871b6422/0x5bf8706fdac8dc33 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.192452:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089634dfb/0x5bf8706fdac8dc3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.192453:0:23782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000871b6422/0x5bf8706fdac8dc33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.192459:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089634dfb/0x5bf8706fdac8dc3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.192469:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574528.192472:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089634dfb/0x5bf8706fdac8dc3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.192485:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.192488:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089634dfb/0x5bf8706fdac8dc3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.192496:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089634dfb/0x5bf8706fdac8dc3a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.192507:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089634dfb/0x5bf8706fdac8dc3a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.192515:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.192516:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.192706:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.192712:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089634dfb/0x5bf8706fdac8dc3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.193425:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574528.195607:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.195622:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cca213c/0x5bf8706fdac8dc41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.195639:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.195644:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.195650:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cca213c/0x5bf8706fdac8dc41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.195675:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cca213c/0x5bf8706fdac8dc41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.195687:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cca213c/0x5bf8706fdac8dc41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.195696:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cca213c/0x5bf8706fdac8dc41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.195722:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574528.195778:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574528.195785:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cca213c/0x5bf8706fdac8dc41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.195793:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2600 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.195797:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cca213c/0x5bf8706fdac8dc41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.195807:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cca213c/0x5bf8706fdac8dc41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.195823:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cca213c/0x5bf8706fdac8dc41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.195836:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cca213c/0x5bf8706fdac8dc41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.195852:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.195854:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.195856:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574528.197412:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.197426:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8dc48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.197442:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.197447:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.197453:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8dc48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.197465:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8dc48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.197490:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8dc48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.197509:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8dc48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.197533:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574528.197780:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574528.197787:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8dc48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.197795:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217fa00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.197799:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8dc48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.197808:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8dc48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.197824:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8dc48 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.197831:0:23782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8dc48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.197847:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.197849:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.197851:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574528.198132:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.198139:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8dc4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.198148:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.198151:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.198156:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8dc4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.198166:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8dc4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.198174:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8dc4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.198182:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8dc4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.198218:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574528.198516:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574528.198521:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8dc4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.198529:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217f200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.198533:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8dc4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.198542:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8dc4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.198553:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8dc4f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.198560:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8dc4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.198576:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.198578:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.198579:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574528.198659:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.198665:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8dc56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.198679:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.198682:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.198687:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8dc56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.198696:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8dc56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.198704:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8dc56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.198711:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8dc56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.198730:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574528.198813:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574528.198819:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8dc56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.198827:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217e400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574528.198830:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8dc56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.198838:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8dc56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.198850:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8dc56 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.198857:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8dc56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574528.198997:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.199002:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8dc5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.199011:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.199014:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.199018:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8dc5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.199027:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8dc5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.199046:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8dc5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.199054:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8dc5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.199072:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574528.199161:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574528.199167:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8dc5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.199184:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217e800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.199368:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574528.199492:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.199498:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.199506:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.199509:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.199514:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.199523:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.199530:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.199537:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.199719:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574528.199724:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.199731:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204bc00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574528.199734:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.199741:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.199766:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc64 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.199774:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.199775:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.199795:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.199799:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.199820:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8dc5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.199830:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8dc5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.199841:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8dc5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.199848:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8dc5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574528.199861:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574528.199862:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574528.200110:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.200117:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021220d68/0x5bf8706fdac8dc6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.200125:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.200128:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.200133:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021220d68/0x5bf8706fdac8dc6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.200142:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021220d68/0x5bf8706fdac8dc6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.200150:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021220d68/0x5bf8706fdac8dc6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.200157:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021220d68/0x5bf8706fdac8dc6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.200222:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574528.200228:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021220d68/0x5bf8706fdac8dc6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.200236:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204a800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.200239:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021220d68/0x5bf8706fdac8dc6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.200260:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021220d68/0x5bf8706fdac8dc6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.200272:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021220d68/0x5bf8706fdac8dc6b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.200279:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.200281:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.200283:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.200584:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574528.204731:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.207569:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.207586:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021220d68/0x5bf8706fdac8dc6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574528.208143:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.208150:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b160fcb9/0x5bf8706fdac8dc72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.208166:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.208170:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.208177:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b160fcb9/0x5bf8706fdac8dc72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.208284:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b160fcb9/0x5bf8706fdac8dc72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.208351:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b160fcb9/0x5bf8706fdac8dc72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.208361:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b160fcb9/0x5bf8706fdac8dc72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.209614:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574528.209625:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b160fcb9/0x5bf8706fdac8dc72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.209647:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204b200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574528.209652:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b160fcb9/0x5bf8706fdac8dc72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.209663:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b160fcb9/0x5bf8706fdac8dc72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.209681:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b160fcb9/0x5bf8706fdac8dc72 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.209690:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.209691:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.209693:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.209785:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.209793:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b160fcb9/0x5bf8706fdac8dc72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574528.210423:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.210431:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c30a402/0x5bf8706fdac8dc79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.210452:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.210457:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.210463:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c30a402/0x5bf8706fdac8dc79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.210475:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c30a402/0x5bf8706fdac8dc79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.210484:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c30a402/0x5bf8706fdac8dc79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.210491:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c30a402/0x5bf8706fdac8dc79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.210673:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574528.210680:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c30a402/0x5bf8706fdac8dc79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.210687:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204a200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574528.210691:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c30a402/0x5bf8706fdac8dc79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.210700:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c30a402/0x5bf8706fdac8dc79 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.210714:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c30a402/0x5bf8706fdac8dc79 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.210729:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.210730:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.210732:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.210843:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.210848:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c30a402/0x5bf8706fdac8dc79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574528.211164:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.211171:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077047f3f/0x5bf8706fdac8dc80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.211180:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.211183:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.211295:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077047f3f/0x5bf8706fdac8dc80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.211376:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077047f3f/0x5bf8706fdac8dc80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.211384:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077047f3f/0x5bf8706fdac8dc80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.211392:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077047f3f/0x5bf8706fdac8dc80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.211460:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574528.211466:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077047f3f/0x5bf8706fdac8dc80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.211475:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204ac00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.211478:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077047f3f/0x5bf8706fdac8dc80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.211487:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077047f3f/0x5bf8706fdac8dc80 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.211499:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077047f3f/0x5bf8706fdac8dc80 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.211507:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.211509:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.211510:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.211723:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.211728:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077047f3f/0x5bf8706fdac8dc80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574528.212980:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.212990:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.213003:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.213007:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.213013:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.213025:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.213046:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.213053:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.213109:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574528.213115:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.213123:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204bc00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574528.213127:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.213135:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.213151:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc87 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.213159:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.213161:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.213162:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.213420:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.213426:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f86ba1f/0x5bf8706fdac8dc87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574528.213854:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.213860:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004139a730/0x5bf8706fdac8dc8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.213869:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.213872:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.213876:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004139a730/0x5bf8706fdac8dc8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.213886:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004139a730/0x5bf8706fdac8dc8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.213895:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004139a730/0x5bf8706fdac8dc8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.213913:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004139a730/0x5bf8706fdac8dc8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.213941:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574528.213946:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004139a730/0x5bf8706fdac8dc8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.213953:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204b000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574528.213956:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004139a730/0x5bf8706fdac8dc8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.213972:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004139a730/0x5bf8706fdac8dc8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.213985:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004139a730/0x5bf8706fdac8dc8e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.213994:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.213996:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.213997:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.214065:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.214070:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004139a730/0x5bf8706fdac8dc8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574528.214513:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.214520:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007568522e/0x5bf8706fdac8dc95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.214528:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.214532:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.214536:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007568522e/0x5bf8706fdac8dc95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.214557:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007568522e/0x5bf8706fdac8dc95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.214565:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007568522e/0x5bf8706fdac8dc95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.214573:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007568522e/0x5bf8706fdac8dc95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.216369:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574528.216381:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007568522e/0x5bf8706fdac8dc95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.216394:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204a400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.216399:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007568522e/0x5bf8706fdac8dc95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.216409:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007568522e/0x5bf8706fdac8dc95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.216427:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007568522e/0x5bf8706fdac8dc95 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.216438:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.216439:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.216441:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.216535:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.216607:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007568522e/0x5bf8706fdac8dc95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574528.217085:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.217092:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055846700/0x5bf8706fdac8dc9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.217104:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.217108:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.217114:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055846700/0x5bf8706fdac8dc9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.217126:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055846700/0x5bf8706fdac8dc9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.217134:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055846700/0x5bf8706fdac8dc9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.217142:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055846700/0x5bf8706fdac8dc9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.217159:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788574528.217651:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.217658:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013803438/0x5bf8706fdac8dca3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.217673:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.217677:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.217681:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013803438/0x5bf8706fdac8dca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.217691:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013803438/0x5bf8706fdac8dca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.217698:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013803438/0x5bf8706fdac8dca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.217706:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013803438/0x5bf8706fdac8dca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.217718:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788574528.217988:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574528.217996:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055846700/0x5bf8706fdac8dc9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.218004:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204a000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.218008:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055846700/0x5bf8706fdac8dc9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.218018:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055846700/0x5bf8706fdac8dc9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.218048:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055846700/0x5bf8706fdac8dc9c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.218056:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055846700/0x5bf8706fdac8dc9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.218076:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574528.218079:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013803438/0x5bf8706fdac8dca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.218085:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204ba00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.218088:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013803438/0x5bf8706fdac8dca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.218096:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013803438/0x5bf8706fdac8dca3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.218106:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013803438/0x5bf8706fdac8dca3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.218114:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013803438/0x5bf8706fdac8dca3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.218128:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.218130:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.218137:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.218145:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574528.218389:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.218396:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008011b35/0x5bf8706fdac8dcaa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.218404:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.218408:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.218413:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008011b35/0x5bf8706fdac8dcaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.218424:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008011b35/0x5bf8706fdac8dcaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.218444:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008011b35/0x5bf8706fdac8dcaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.218453:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008011b35/0x5bf8706fdac8dcaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.218469:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574528.218640:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574528.218645:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008011b35/0x5bf8706fdac8dcaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.218652:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204a600 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.218655:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008011b35/0x5bf8706fdac8dcaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.218664:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008011b35/0x5bf8706fdac8dcaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.218675:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008011b35/0x5bf8706fdac8dcaa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.218682:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008011b35/0x5bf8706fdac8dcaa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.218696:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.218698:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.218699:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574528.218941:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.218947:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e22631f/0x5bf8706fdac8dcb1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.218955:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.218958:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.218963:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e22631f/0x5bf8706fdac8dcb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.218972:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e22631f/0x5bf8706fdac8dcb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.218979:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e22631f/0x5bf8706fdac8dcb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.218985:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e22631f/0x5bf8706fdac8dcb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.219043:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788574528.219423:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.219429:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d49959d4/0x5bf8706fdac8dcb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.219438:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.219441:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.219445:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d49959d4/0x5bf8706fdac8dcb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.219454:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d49959d4/0x5bf8706fdac8dcb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.219461:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d49959d4/0x5bf8706fdac8dcb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.219470:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d49959d4/0x5bf8706fdac8dcb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.219620:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574528.219626:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e22631f/0x5bf8706fdac8dcb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.219634:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204aa00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.219637:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e22631f/0x5bf8706fdac8dcb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.219656:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e22631f/0x5bf8706fdac8dcb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.219672:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e22631f/0x5bf8706fdac8dcb1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.219679:0:23782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e22631f/0x5bf8706fdac8dcb1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.219696:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574528.219700:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d49959d4/0x5bf8706fdac8dcb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.219706:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204b800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.219709:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d49959d4/0x5bf8706fdac8dcb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.219716:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d49959d4/0x5bf8706fdac8dcb8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.219726:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d49959d4/0x5bf8706fdac8dcb8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.219733:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.219734:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.219741:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.219816:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.219822:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d49959d4/0x5bf8706fdac8dcb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574528.220166:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.220173:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a40cbdcf/0x5bf8706fdac8dcbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.220205:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.220220:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.220224:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a40cbdcf/0x5bf8706fdac8dcbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.220233:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a40cbdcf/0x5bf8706fdac8dcbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.220241:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a40cbdcf/0x5bf8706fdac8dcbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.220247:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a40cbdcf/0x5bf8706fdac8dcbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.220393:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574528.220398:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a40cbdcf/0x5bf8706fdac8dcbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.220406:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204b400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.220409:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a40cbdcf/0x5bf8706fdac8dcbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.220416:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a40cbdcf/0x5bf8706fdac8dcbf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.220428:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a40cbdcf/0x5bf8706fdac8dcbf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.220435:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.220437:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.220438:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.220502:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.220622:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.220628:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a40cbdcf/0x5bf8706fdac8dcbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574528.220994:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.221000:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8dcc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.221010:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.221014:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.221019:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8dcc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.221041:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8dcc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.221050:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8dcc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.221058:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8dcc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.221094:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574528.221099:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8dcc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.221107:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac8800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.221110:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8dcc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.221118:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8dcc6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.221141:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8dcc6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.221149:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.221151:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.221153:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.221677:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.221684:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8dcc6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574528.222315:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.222323:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e94797/0x5bf8706fdac8dccd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.222335:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.222339:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.222345:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096e94797/0x5bf8706fdac8dccd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.222356:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096e94797/0x5bf8706fdac8dccd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.222374:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e94797/0x5bf8706fdac8dccd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.222382:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096e94797/0x5bf8706fdac8dccd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.224105:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574528.224121:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096e94797/0x5bf8706fdac8dccd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.224134:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac9a00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.224140:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e94797/0x5bf8706fdac8dccd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.224150:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e94797/0x5bf8706fdac8dccd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.224172:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096e94797/0x5bf8706fdac8dccd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.224184:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.224200:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574528.224261:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.225485:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.225496:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096e94797/0x5bf8706fdac8dccd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.225623:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574528.226139:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.226147:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2fe1a02/0x5bf8706fdac8dcd4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.226160:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.226165:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.226171:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fe1a02/0x5bf8706fdac8dcd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.226184:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2fe1a02/0x5bf8706fdac8dcd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.226635:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2fe1a02/0x5bf8706fdac8dcd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.226656:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fe1a02/0x5bf8706fdac8dcd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.226719:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788574528.228356:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.228367:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099544d4b/0x5bf8706fdac8dcdb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.228383:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.228387:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.228394:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099544d4b/0x5bf8706fdac8dcdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.228406:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099544d4b/0x5bf8706fdac8dcdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.228415:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099544d4b/0x5bf8706fdac8dcdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.228423:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099544d4b/0x5bf8706fdac8dcdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.228678:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574528.228687:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2fe1a02/0x5bf8706fdac8dcd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.228695:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac8400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574528.228700:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2fe1a02/0x5bf8706fdac8dcd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.228710:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2fe1a02/0x5bf8706fdac8dcd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.228727:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2fe1a02/0x5bf8706fdac8dcd4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.228735:0:23782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2fe1a02/0x5bf8706fdac8dcd4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.228771:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574528.228775:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099544d4b/0x5bf8706fdac8dcdb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.228781:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac8a00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574528.228784:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099544d4b/0x5bf8706fdac8dcdb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.228791:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099544d4b/0x5bf8706fdac8dcdb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.228801:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099544d4b/0x5bf8706fdac8dcdb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.228809:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.228811:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.228812:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.228880:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.228886:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099544d4b/0x5bf8706fdac8dcdb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574528.229862:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.229873:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000def1ca82/0x5bf8706fdac8dce2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.229887:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.229892:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.229898:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000def1ca82/0x5bf8706fdac8dce2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.229908:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000def1ca82/0x5bf8706fdac8dce2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.229917:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000def1ca82/0x5bf8706fdac8dce2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.229925:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000def1ca82/0x5bf8706fdac8dce2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.231402:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574528.231414:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000def1ca82/0x5bf8706fdac8dce2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.231443:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac8200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574528.231448:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000def1ca82/0x5bf8706fdac8dce2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.231458:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000def1ca82/0x5bf8706fdac8dce2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574528.231477:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000def1ca82/0x5bf8706fdac8dce2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.231555:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.231558:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.231559:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.231686:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.231694:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000def1ca82/0x5bf8706fdac8dce2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574528.232230:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.232237:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa7f21ee/0x5bf8706fdac8dce9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.232257:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.232261:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.232267:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa7f21ee/0x5bf8706fdac8dce9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.232279:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa7f21ee/0x5bf8706fdac8dce9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.232287:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa7f21ee/0x5bf8706fdac8dce9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.232295:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa7f21ee/0x5bf8706fdac8dce9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.232523:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574528.232530:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa7f21ee/0x5bf8706fdac8dce9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.232538:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac8000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574528.232610:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa7f21ee/0x5bf8706fdac8dce9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.232628:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa7f21ee/0x5bf8706fdac8dce9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.232642:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa7f21ee/0x5bf8706fdac8dce9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.232651:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.232653:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.232654:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.232719:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.232724:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa7f21ee/0x5bf8706fdac8dce9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574528.233085:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574528.233091:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005259eb0a/0x5bf8706fdac8dcf0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.233101:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1788574528.233105:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574528.233110:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005259eb0a/0x5bf8706fdac8dcf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.233131:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005259eb0a/0x5bf8706fdac8dcf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.233139:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005259eb0a/0x5bf8706fdac8dcf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574528.233146:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005259eb0a/0x5bf8706fdac8dcf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.233175:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574528.233181:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005259eb0a/0x5bf8706fdac8dcf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.233286:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac9200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574528.233290:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005259eb0a/0x5bf8706fdac8dcf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.233368:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005259eb0a/0x5bf8706fdac8dcf0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.233387:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005259eb0a/0x5bf8706fdac8dcf0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574528.233398:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.233400:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574528.233403:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574528.234100:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574528.234108:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005259eb0a/0x5bf8706fdac8dcf0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788574528.234591:0:24138:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1788574528.234688:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22652:x1875455681758336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 76217us (77694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574528.234698:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788574528.234933:0:22652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22652:1875455681758336:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788574528.234949:0:22652:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1788574528.234997:0:22652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9b4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22652:1875455681758464:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788574528.235035:0:22652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574528.235060:0:22652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c4e2e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574528.235078:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681758464 00000100:00100000:0.0:1788574528.235084:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681758464 00000100:00100000:0.0:1788574528.235121:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788574528.235130:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22652:x1875455681758464:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788574528.235165:0:24136:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:1.0:1788574528.237375:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788574528.244872:0:24132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1788574528.244927:0:24132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788574528.245853:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22652:x1875455681758464:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10717us (10810us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788574528.245867:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574528.246666:0:22652:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788574528.246679:0:22652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9b4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22652:1875455681758464:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788574528.246697:0:22652:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000040:00080000:0.0:1788574528.411626:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788574529.043441:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788574529.342109:0:24953:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788574529.342695:0:24953:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788574529.342696:0:24953:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788574529.342852:0:24953:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c85f7a09800 00000020:01000004:2.0:1788574529.342872:0:24953:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788574529.342888:0:24953:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788574529.342904:0:24953:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c84c27099c0) 00000020:00000080:2.0:1788574529.342923:0:24953:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788574529.423417:0:24953:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788574529.431267:0:24953:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788574529.432180:0:24953:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788574529.432939:0:24953:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788574529.433231:0:24953:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788574529.433632:0:24953:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788574529.434029:0:24953:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1788574529.443137:0:24953:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788574529.445139:0:24953:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788574529.445156:0:24953:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788574529.445170:0:24953:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5bf8706fdac8dcfe 00000020:01000004:0.0:1788574529.445225:0:24953:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788574529.445250:0:24953:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788574529.445254:0:24953:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788574529.445260:0:24953:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788574529.445400:0:24953:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788574529.445405:0:24953:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788574529.483375:0:24953:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788574529.483416:0:24953:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.151@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788574529.483421:0:24953:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788574529.483423:0:24953:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788574529.483424:0:24953:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574529.483426:0:24953:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574529.483427:0:24953:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574529.483429:0:24953:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574529.483430:0:24953:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574529.483432:0:24953:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574529.483434:0:24953:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788574529.483438:0:24953:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788574529.483440:0:24953:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788574529.483441:0:24953:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788574529.483442:0:24953:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574529.483444:0:24953:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574529.483445:0:24953:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574529.483446:0:24953:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574529.483447:0:24953:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574529.483448:0:24953:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574529.483449:0:24953:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788574529.483474:0:24953:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788574529.483498:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681758592:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788574529.483768:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574529.483824:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa319780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574529.483904:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681758592 00000100:00100000:3.0:1788574529.483912:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681758592 00000100:00100000:3.0:1788574529.483967:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788574529.483976:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24953:x1875455681758592:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788574529.484005:0:22622:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788574529.484008:0:22622:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788574529.484013:0:22622:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788574529.484582:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24953:x1875455681758592:12345-0@lo:253:mount.lustre.0 Request processed in 606us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574529.484591:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788574529.484749:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681758592:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788574529.484769:0:24953:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788574529.484773:0:24953:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788574529.484774:0:24953:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788574529.484775:0:24953:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574529.484777:0:24953:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574529.484777:0:24953:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574529.484779:0:24953:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574529.484780:0:24953:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574529.484782:0:24953:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574529.484783:0:24953:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788574529.484803:0:24953:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c85f7a09800 from lustre-OST0001 10000000:01000000:1.0:1788574529.484832:0:24953:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788574529.484835:0:24953:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788574529.484843:0:24953:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c8600d599c0 local copy 00010000:00010000:1.0:1788574529.484853:0:24953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8d931 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d938 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574529.484935:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681758720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574529.484967:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574529.485002:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa319780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574529.485052:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681758720 00000100:00100000:3.0:1788574529.485057:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681758720 00000100:00100000:3.0:1788574529.485091:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788574529.485098:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24953:x1875455681758720:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574529.485171:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24953:x1875455681758720:12345-0@lo:501:mount.lustre.0 Request processed in 74us (203us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788574529.485178:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788574529.485316:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681758720:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788574529.485330:0:24953:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788574529.485348:0:24953:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788574529.485354:0:24953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8d931 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d938 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574529.485363:0:24953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8d931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d938 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574529.485385:0:24953:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c85f7a09800 10000000:01000000:2.0:1788574529.485389:0:24953:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788574529.485394:0:24953:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788574529.485397:0:24953:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788574529.485400:0:24953:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788574529.485404:0:24953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788574529.485425:0:24953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8dd05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574529.485444:0:24953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8dd05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574529.485453:0:24953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8dd05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574529.485469:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6676300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681758848:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788574529.485499:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574529.485540:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c45f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574529.485740:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681758848 00000100:00100000:0.0:1788574529.485746:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681758848 00000100:00100000:0.0:1788574529.485769:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788574529.485776:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+21:24953:x1875455681758848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574529.485785:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574529.485797:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d7a00/0x5bf8706fdac8dd0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8dd05 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574529.485819:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d7a00/0x5bf8706fdac8dd0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8dd05 expref: 22 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574529.485829:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d7a00/0x5bf8706fdac8dd0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8dd05 expref: 22 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574529.485850:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7a00, rc 0) 00000100:00100000:0.0:1788574529.485883:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+22:24953:x1875455681758848:12345-0@lo:101:mount.lustre.0 Request processed in 107us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574529.485888:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788574529.486381:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6676300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681758848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574529.486400:0:24953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8dd05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dd0c expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574529.486411:0:24953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8dd05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8dd0c expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574529.487611:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1788574529.490927:0:24953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788574529.493794:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788574529.493863:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788574529.493881:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788574529.493897:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788574529.493909:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788574529.493922:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788574529.493935:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788574529.493947:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788574529.493961:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1788574529.493986:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1788574529.493992:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1788574529.494105:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681758976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574529.494178:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574529.494806:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85f7abed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788574529.495057:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681758976 00000100:00100000:0.0:1788574529.495066:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681758976 00000100:00100000:0.0:1788574529.495182:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788574529.495425:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+22:24953:x1875455681758976:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574529.495989:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+22:24953:x1875455681758976:12345-0@lo:501:mount.lustre.0 Request processed in 797us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574529.496014:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788574529.496093:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681758976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574529.496139:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681759104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574529.496185:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574529.498164:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85f7abed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788574529.498411:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681759104 00000100:00100000:0.0:1788574529.498419:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681759104 00000100:00100000:1.0:1788574529.498646:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788574529.498657:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+22:24953:x1875455681759104:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574529.499475:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+22:24953:x1875455681759104:12345-0@lo:503:mount.lustre.0 Request processed in 815us (3285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574529.499486:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788574529.499603:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681759104:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788574529.500052:0:24953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788574529.500130:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681759232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574529.500182:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574529.501067:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85f7abed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574529.501152:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681759232 00000100:00100000:2.0:1788574529.501159:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681759232 00000100:00100000:2.0:1788574529.501232:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788574529.501241:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+22:24953:x1875455681759232:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574529.503673:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+22:24953:x1875455681759232:12345-0@lo:502:mount.lustre.0 Request processed in 2420us (3478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574529.503688:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788574529.504020:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681759232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788574529.504340:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788574529.504371:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788574529.504386:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788574529.504400:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788574529.504413:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788574529.504427:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788574529.504441:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788574529.504454:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788574529.504466:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1788574529.504505:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681759360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574529.504569:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574529.504602:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85f7abed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574529.504894:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681759360 00000100:00100000:2.0:1788574529.504903:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681759360 00000100:00100000:2.0:1788574529.504941:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788574529.504957:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+22:24953:x1875455681759360:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574529.505074:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+22:24953:x1875455681759360:12345-0@lo:502:mount.lustre.0 Request processed in 117us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574529.505082:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788574529.508070:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681759360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788574529.508225:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1788574529.508241:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788574529.511816:0:24957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788574529.511829:0:24957:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788574529.511845:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574529.511848:0:24957:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788574529.511856:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788574529.511874:0:24957:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c84c3038000) 00000020:00000080:3.0:1788574529.511913:0:24957:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788574529.511920:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788574529.511991:0:24957:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c85f7a09800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788574529.512001:0:24957:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788574529.512009:0:24957:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5bf8706fdac8dd1a 00010000:00010000:3.0:1788574529.522736:0:24957:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788574529.523946:0:24957:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:3.0:1788574529.526885:0:24957:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788574529.536463:0:24957:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788574529.536480:0:24957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574529.536488:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574529.536491:0:24957:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788574529.536495:0:24957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574529.536500:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574529.536502:0:24957:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788574529.536506:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788574529.536508:0:24957:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788574529.536510:0:24957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574529.536808:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574529.536811:0:24957:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788574529.536817:0:24957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574529.536820:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574529.536822:0:24957:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788574529.536826:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788574529.536929:0:24957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574529.536934:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574529.536935:0:24957:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788574529.536939:0:24957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1788574529.543903:0:24953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788574529.543955:0:24953:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788574529.543988:0:24953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8dd05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dd0c expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574529.544003:0:24953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8dd05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dd0c expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574529.544012:0:24953:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85f7a09800 from 1 10000000:01000000:0.0:1788574529.544015:0:24953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788574529.544061:0:24953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8dd21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574529.544070:0:24953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8dd21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574529.544081:0:24953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8dd21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574529.544106:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681759488:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788574529.544477:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574529.544566:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c4e29b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574529.552537:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681759488 00000100:00100000:2.0:1788574529.552553:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681759488 00000100:00100000:2.0:1788574529.552667:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788574529.552678:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+22:24953:x1875455681759488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574529.552696:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574529.552717:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8dd28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8dd21 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574529.552761:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8dd28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8dd21 expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574529.552773:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8dd28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8dd21 expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574529.552784:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e000, rc 0) 00000100:00100000:2.0:1788574529.552879:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+23:24953:x1875455681759488:12345-0@lo:101:mount.lustre.0 Request processed in 203us (8692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574529.552886:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788574529.552993:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681759488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574529.553013:0:24953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8dd21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dd28 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574529.553041:0:24953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8dd21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8dd28 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788574529.561006:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788574529.561605:0:24953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574529.562009:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788574529.562035:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788574529.562049:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788574529.562062:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788574529.562076:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788574529.562088:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788574529.562100:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788574529.562112:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788574529.562125:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788574529.562137:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788574529.562150:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788574529.562169:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788574529.562175:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788574529.566413:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681759616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574529.566492:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574529.566575:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa319780 going to sleep for 11 seconds 00000100:00100000:0.0:1788574529.568635:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681759616 00000100:00100000:0.0:1788574529.568649:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681759616 00000100:00100000:0.0:1788574529.568707:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788574529.568718:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+23:24953:x1875455681759616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574529.569050:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+23:24953:x1875455681759616:12345-0@lo:501:mount.lustre.0 Request processed in 333us (2558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574529.569059:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788574529.573086:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681759616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574529.573973:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681759744:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574529.574067:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574529.574434:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e51300 going to sleep for 11 seconds 00000100:00100000:2.0:1788574529.574535:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681759744 00000100:00100000:2.0:1788574529.574544:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681759744 00000100:00100000:2.0:1788574529.574603:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788574529.574613:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+23:24953:x1875455681759744:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574529.574768:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+23:24953:x1875455681759744:12345-0@lo:503:mount.lustre.0 Request processed in 156us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574529.574776:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788574529.574893:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681759744:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788574529.577998:0:24953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788574529.578141:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681759872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574529.578249:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574529.578757:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa319780 going to sleep for 11 seconds 00000100:00100000:0.0:1788574529.578859:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681759872 00000100:00100000:0.0:1788574529.578867:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681759872 00000100:00100000:0.0:1788574529.578922:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788574529.578931:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+23:24953:x1875455681759872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574529.579066:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+23:24953:x1875455681759872:12345-0@lo:502:mount.lustre.0 Request processed in 136us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574529.579075:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788574529.579468:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681759872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788574529.579707:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788574529.579751:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788574529.579767:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788574529.579780:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788574529.579793:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788574529.579805:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788574529.579817:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788574529.579829:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788574529.579841:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788574529.579859:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788574529.579869:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788574529.579900:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681760000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574529.579953:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574529.579990:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e51300 going to sleep for 11 seconds 00000100:00100000:0.0:1788574529.580283:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681760000 00000100:00100000:0.0:1788574529.580289:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681760000 00000100:00100000:0.0:1788574529.580330:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788574529.580339:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+23:24953:x1875455681760000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574529.580447:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+23:24953:x1875455681760000:12345-0@lo:502:mount.lustre.0 Request processed in 109us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574529.580455:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788574529.580730:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681760000:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788574529.581140:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788574529.581153:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788574529.586038:0:24961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574529.586053:0:24961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574529.586055:0:24961:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788574529.586063:0:24961:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c85f7a09800 00000020:00000080:2.0:1788574529.586065:0:24961:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788574529.586072:0:24961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574529.586074:0:24961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574529.586075:0:24961:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788574529.586077:0:24961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574529.586079:0:24961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574529.586080:0:24961:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788574529.586083:0:24961:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c85f7a09800 00000020:00000080:2.0:1788574529.586084:0:24961:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788574529.595657:0:24961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574529.595675:0:24961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574529.595677:0:24961:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788574529.595682:0:24961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574529.595685:0:24961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574529.595687:0:24961:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788574529.595692:0:24961:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c85f7a09800 00000020:00000080:2.0:1788574529.595694:0:24961:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788574529.611669:0:24961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574529.611684:0:24961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574529.611686:0:24961:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788574529.611690:0:24961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574529.611695:0:24961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574529.611697:0:24961:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788574529.611701:0:24961:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c85f7a09800 00000020:00000080:2.0:1788574529.611704:0:24961:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788574529.611786:0:24961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574529.611790:0:24961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574529.611792:0:24961:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788574529.611795:0:24961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788574529.621859:0:24953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788574529.621913:0:24953:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788574529.621943:0:24953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8dd21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dd28 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574529.621956:0:24953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8dd21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dd28 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574529.622029:0:24953:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788574529.622032:0:24953:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c85f7a09800 10000000:01000000:0.0:1788574529.622036:0:24953:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c85f7a09800 10000000:01000000:0.0:1788574529.622040:0:24953:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788574529.622046:0:24953:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85f7a09800 from 1 10000000:01000000:0.0:1788574529.622049:0:24953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788574529.622085:0:24953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6600/0x5bf8706fdac8dd2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574529.622095:0:24953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6600/0x5bf8706fdac8dd2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574529.622133:0:24953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6600/0x5bf8706fdac8dd2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574529.622160:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681760128:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788574529.622252:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574529.624230:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c4e29840 going to sleep for 11 seconds 00000100:00100000:1.0:1788574529.631582:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681760128 00000100:00100000:1.0:1788574529.631608:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681760128 00000100:00100000:1.0:1788574529.631676:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788574529.631686:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+23:24953:x1875455681760128:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574529.631704:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574529.631744:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d08a2400/0x5bf8706fdac8dd36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8dd2f expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.631776:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d08a2400/0x5bf8706fdac8dd36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8dd2f expref: 24 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.631788:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d08a2400/0x5bf8706fdac8dd36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8dd2f expref: 24 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.631797:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a2400, rc 0) 00000100:00100000:1.0:1788574529.631873:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+24:24953:x1875455681760128:12345-0@lo:101:mount.lustre.0 Request processed in 189us (9621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574529.631880:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788574529.640550:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681760128:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574529.640582:0:24953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6600/0x5bf8706fdac8dd2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dd36 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574529.640596:0:24953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6600/0x5bf8706fdac8dd2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8dd36 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788574529.654892:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788574529.655259:0:24953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574529.656012:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788574529.656061:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788574529.656078:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788574529.656091:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788574529.656116:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788574529.656134:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788574529.656146:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788574529.656159:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788574529.656172:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788574529.656186:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788574529.656227:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788574529.656241:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788574529.656257:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788574529.656281:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788574529.656307:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788574529.656321:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788574529.656333:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788574529.656358:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788574529.656373:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788574529.656388:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788574529.656403:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788574529.656421:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788574529.656436:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788574529.656452:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788574529.656465:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788574529.656478:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788574529.656492:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788574529.656506:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788574529.656519:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788574529.656533:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788574529.656547:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788574529.656561:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788574529.656574:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788574529.656601:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788574529.656618:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788574529.656631:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788574529.656644:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788574529.656656:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788574529.656668:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788574529.656680:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788574529.656693:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788574529.656706:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788574529.656728:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788574529.656745:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788574529.658879:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788574529.658902:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788574529.658917:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788574529.658949:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788574529.660764:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788574529.660823:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788574529.660850:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788574529.660856:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788574529.660976:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681760256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574529.661046:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574529.661925:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c4e293c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574529.662649:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681760256 00000100:00100000:2.0:1788574529.662658:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681760256 00000100:00100000:2.0:1788574529.662708:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788574529.662729:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+24:24953:x1875455681760256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574529.662895:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+24:24953:x1875455681760256:12345-0@lo:501:mount.lustre.0 Request processed in 178us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574529.662902:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788574529.663811:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681760256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574529.663874:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681760384:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574529.663931:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574529.663975:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c4e293c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574529.664774:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681760384 00000100:00100000:1.0:1788574529.664782:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681760384 00000100:00100000:1.0:1788574529.664828:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788574529.664847:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+24:24953:x1875455681760384:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574529.664972:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+24:24953:x1875455681760384:12345-0@lo:503:mount.lustre.0 Request processed in 136us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574529.664981:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788574529.665031:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681760384:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788574529.667605:0:24953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788574529.667755:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681760512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574529.667991:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574529.668040:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c384f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788574529.668080:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681760512 00000100:00100000:3.0:1788574529.668095:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681760512 00000100:00100000:3.0:1788574529.668158:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788574529.668167:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+24:24953:x1875455681760512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574529.668304:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+24:24953:x1875455681760512:12345-0@lo:502:mount.lustre.0 Request processed in 137us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574529.668313:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788574529.670342:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681760512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788574529.670584:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788574529.670626:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788574529.670639:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788574529.670651:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788574529.670664:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788574529.670676:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788574529.670688:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788574529.670700:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788574529.670713:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788574529.670737:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788574529.670752:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788574529.670765:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788574529.670778:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788574529.670789:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788574529.670800:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788574529.670810:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788574529.670851:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788574529.670869:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788574529.670881:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788574529.670892:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788574529.670905:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788574529.670919:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788574529.670931:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788574529.670943:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788574529.670954:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788574529.670965:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788574529.670977:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788574529.670990:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788574529.671003:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788574529.671015:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788574529.671028:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788574529.671043:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788574529.671072:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788574529.671087:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788574529.671110:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788574529.671125:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788574529.671137:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788574529.671150:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788574529.671165:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788574529.671179:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788574529.671222:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788574529.671240:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788574529.671256:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788574529.671271:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788574529.671286:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788574529.671301:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788574529.671314:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788574529.671328:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788574529.671398:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681760640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574529.671472:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574529.671507:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c253ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574529.672059:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681760640 00000100:00100000:0.0:1788574529.672069:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681760640 00000100:00100000:0.0:1788574529.672207:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788574529.672221:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+24:24953:x1875455681760640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574529.672380:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+24:24953:x1875455681760640:12345-0@lo:502:mount.lustre.0 Request processed in 162us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574529.672389:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788574529.672554:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681760640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788574529.672770:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788574529.672795:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788574529.672824:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681760768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574529.672956:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574529.672987:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c384f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788574529.673039:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681760768 00000100:00100000:0.0:1788574529.673044:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681760768 00000100:00100000:0.0:1788574529.673078:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788574529.673085:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+24:24953:x1875455681760768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574529.673472:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+24:24953:x1875455681760768:12345-0@lo:502:mount.lustre.0 Request processed in 387us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574529.673480:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788574529.673558:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681760768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788574529.673610:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788574529.673621:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788574529.674841:0:24967:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788574529.674862:0:24967:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c85d00c3380) 00000020:00000080:1.0:1788574529.674894:0:24967:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788574529.674995:0:24967:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c85f7a09800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788574529.675000:0:24967:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85f7a09800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788574529.675003:0:24967:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85f7a09800 3 00010000:00080000:1.0:1788574529.675037:0:24967:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c84c34d2800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1788574529.681218:0:24967:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788574529.682137:0:24967:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788574529.682222:0:24967:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788574529.682238:0:24967:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5bf8706fdac8dd44 00000100:00080000:1.0:1788574529.682250:0:24967:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788574529.682256:0:24967:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c84c34d2800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574529.682293:0:24967:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85faf5c380 x1875455681760896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574529.682340:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875455681760896:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788574529.682411:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574529.682475:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681760896 00000100:00100000:1.0:1788574529.682482:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681760896 00000100:00100000:1.0:1788574529.682510:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788574529.682517:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1875455681760896:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788574529.682541:0:23650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 669 last 0 00000020:00000080:1.0:1788574529.682570:0:23650:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5bf8706fdac8dd4b 00000004:00100000:1.0:1788574529.682587:0:23650:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788574529.682619:0:23650:0:(import.c:65:import_set_state_nolock()) ffff9c84c34d5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574529.682666:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875455681760896:12345-0@lo:38:llog_process_th.0 Request processed in 148us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574529.682675:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788574529.682712:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85faf5c380 x1875455681760896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574529.682747:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574529.682754:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788574529.682760:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788574529.682764:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788574529.682766:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c34d2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788574529.682771:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875455681760896:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788574529.682790:0:24967:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788574529.683210:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574529.683216:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788574529.683218:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85f6de8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574529.683223:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 668 00000100:00080000:2.0:1788574529.683226:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788574529.683231:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c85f6de8000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574529.683239:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681761152:0@lo:400:kworker.0 00000100:00100000:2.0:1788574529.683248:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85f6674a80 x1875455681761280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788574529.683290:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788574529.683307:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574529.683311:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788574529.683313:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c84c369d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574529.683317:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 668 00000100:00080000:2.0:1788574529.683319:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1788574529.683323:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00080000:2.0:1788574529.683324:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c84c369d800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574529.683335:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681761024:0@lo:400:kworker.0 00000100:00100000:2.0:1788574529.683340:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c2336d80 x1875455681761792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788574529.683366:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574529.683392:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681761664:0@lo:400:kworker.0 00000100:00100000:3.0:1788574529.683422:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574529.683445:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681761920:0@lo:400:kworker.0 00000100:00100000:3.0:1788574529.683471:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574529.683524:0:24616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681761152 00000100:00100000:0.0:1788574529.683846:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681761536:0@lo:400:kworker.0 00000100:00100000:0.0:1788574529.683885:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574529.683909:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875455681762176:0@lo:400:kworker.0 00000100:00100000:0.0:1788574529.683928:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574529.683944:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788574529.683950:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681761408:0@lo:400:kworker.0 00000100:00100000:0.0:1788574529.683968:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574529.683984:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681762048:0@lo:400:kworker.0 00000100:00100000:0.0:1788574529.684002:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574529.684995:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681761024 00000100:00100000:0.0:1788574529.685006:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681761024 00000100:00100000:0.0:1788574529.685047:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681761536 00000100:00100000:0.0:1788574529.685050:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681761536 00000100:00100000:0.0:1788574529.685067:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788574529.685075:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681761024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574529.685144:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681761024:12345-0@lo:400:kworker.0 Request processed in 70us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574529.685153:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788574529.685154:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681761920 00000100:00100000:2.0:1788574529.685161:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681761920 00000100:00100000:0.0:1788574529.685172:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788574529.685181:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681761536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574529.685237:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681762176 00000100:00100000:2.0:1788574529.685242:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681762176 00000100:00100000:0.0:1788574529.685242:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681761536:12345-0@lo:400:kworker.0 Request processed in 63us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574529.685252:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788574529.685271:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681761408 00000100:00100000:2.0:1788574529.685276:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681761408 00000100:00100000:2.0:1788574529.685286:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681762048 00000100:00100000:2.0:1788574529.685289:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681762048 00000100:00100000:2.0:1788574529.685302:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788574529.685308:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681761920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574529.685347:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681761920:12345-0@lo:400:kworker.0 Request processed in 40us (1876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574529.685353:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788574529.685366:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788574529.685372:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875455681762176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574529.685399:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875455681762176:12345-0@lo:400:kworker.0 Request processed in 27us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574529.685404:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788574529.685415:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788574529.685420:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681761408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574529.685581:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681761408:12345-0@lo:400:kworker.0 Request processed in 26us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574529.685589:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788574529.685601:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788574529.685607:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681762048:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788574529.685730:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574529.685736:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788574529.685771:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681761280:0@lo:8:kworker.0 00000100:00100000:3.0:1788574529.685859:0:24616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681761152 00000100:00100000:3.0:1788574529.685973:0:24616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681761664 00000100:00100000:3.0:1788574529.685978:0:24616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681761664 00000100:00100000:3.0:1788574529.686003:0:24616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788574529.686010:0:24616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681761152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574529.687542:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574529.687578:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681761792:0@lo:8:kworker.0 00000100:00100000:1.0:1788574529.687608:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1788574529.687772:0:24967:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788574529.687790:0:24967:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9c85d00c19c0) 00000020:00000080:1.0:1788574529.687818:0:24967:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788574529.687958:0:24967:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c85f7a09800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788574529.687963:0:24967:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85f7a09800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788574529.687966:0:24967:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85f7a09800 3 00010000:00080000:1.0:1788574529.687996:0:24967:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c84c34d4000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1788574529.690426:0:24967:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788574529.691641:0:24967:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788574529.691696:0:24967:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788574529.691709:0:24967:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5bf8706fdac8dd59 00000100:00080000:1.0:1788574529.691731:0:24967:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788574529.691737:0:24967:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c84c34d4000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574529.691784:0:24967:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85faf5ce00 x1875455681762304/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574529.691822:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1875455681762304:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788574529.692034:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574529.692100:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681762304 00000100:00100000:2.0:1788574529.692167:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681762048:12345-0@lo:400:kworker.0 Request processed in 6557us (8161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574529.692184:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788574529.692229:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85f6674700 x1875455681761408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574529.692246:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681761408:0@lo:400:kworker.0 00010000:00080000:0.0:1788574529.692344:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2334700 x1875455681762048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574529.692354:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681762048:0@lo:400:kworker.0 00000100:00100000:0.0:1788574529.692368:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681761536:0@lo:400:kworker.0 00010000:00080000:0.0:1788574529.692380:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2335f80 x1875455681762176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574529.692387:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875455681762176:0@lo:400:kworker.0 00000100:00100000:1.0:1788574529.695229:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681762304 00000100:00100000:1.0:1788574529.695400:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788574529.695408:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1875455681762304:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788574529.695440:0:22629:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 669 last 0 00000020:00000080:1.0:1788574529.695480:0:22629:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5bf8706fdac8dd60 00000004:00100000:1.0:1788574529.695498:0:22629:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788574529.695534:0:22629:0:(import.c:65:import_set_state_nolock()) ffff9c84c34d3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574529.695625:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875455681762304:12345-0@lo:38:llog_process_th.0 Request processed in 216us (3591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574529.695633:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788574529.695696:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85faf5ce00 x1875455681762304/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574529.695708:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574529.695716:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788574529.695734:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788574529.695739:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788574529.695742:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c34d4000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788574529.695748:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1875455681762304:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788574529.695773:0:24967:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788574529.696925:0:24616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681761152:12345-0@lo:400:kworker.0 Request processed in 10907us (13629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574529.696941:0:24616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788574529.696971:0:24616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681761280 00000100:00100000:3.0:1788574529.696979:0:24616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681761280 00000100:00100000:3.0:1788574529.696996:0:24616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681761792 00000100:00100000:3.0:1788574529.697007:0:24616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681761792 00000100:00100000:3.0:1788574529.697022:0:24616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574529.697031:0:24616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681761664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574529.697078:0:24616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681761664:12345-0@lo:400:kworker.0 Request processed in 50us (13657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574529.697084:0:24616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574529.697101:0:24616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574529.697105:0:24616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3616:x1875455681761280:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788574529.697160:0:24616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3616:x1875455681761280:12345-0@lo:8:kworker.0 Request processed in 53us (9626us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788574529.697165:0:24616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574529.697176:0:24616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788574529.697181:0:24616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3616:x1875455681761792:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788574529.697223:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574529.697240:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85f6de8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788574529.697246:0:24616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3616:x1875455681761792:12345-0@lo:8:kworker.0 Request processed in 61us (9634us total) trans 0 rc -11/-11 00000100:00080000:1.0:1788574529.697248:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788574529.697257:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681761280:0@lo:8:kworker.0 00000100:00100000:3.0:1788574529.697259:0:24616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788574529.697302:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574529.697350:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574529.697355:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c369d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574529.697359:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788574529.697362:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681761792:0@lo:8:kworker.0 00000040:00080000:0.0:1788574529.698423:0:24967:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1788574529.698497:0:24953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788574529.698541:0:24953:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788574529.698565:0:24953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6600/0x5bf8706fdac8dd2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dd36 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574529.698578:0:24953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6600/0x5bf8706fdac8dd2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dd36 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788574529.698633:0:24953:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788574529.698636:0:24953:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788574529.698637:0:24953:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574529.698639:0:24953:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574529.698640:0:24953:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574529.698641:0:24953:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574529.698643:0:24953:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574529.698645:0:24953:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574529.698646:0:24953:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788574529.698650:0:24953:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788574529.698653:0:24953:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788574529.698654:0:24953:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788574529.698656:0:24953:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574529.698664:0:24953:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574529.698665:0:24953:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574529.698666:0:24953:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574529.698667:0:24953:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574529.698668:0:24953:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574529.698669:0:24953:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788574529.698691:0:24953:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788574529.698709:0:24953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3727100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681762432:0@lo:253:mount.lustre.0 00010000:00080000:3.0:1788574529.706352:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2335c00 x1875455681761920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574529.706371:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681761920:0@lo:400:kworker.0 00000100:00100000:3.0:1788574529.706390:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681761024:0@lo:400:kworker.0 00000100:00100000:3.0:1788574529.706406:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681761664:0@lo:400:kworker.0 00000100:00100000:3.0:1788574529.706417:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681761152:0@lo:400:kworker.0 00000100:00100000:0.0:1788574529.707175:0:24953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574529.707249:0:24953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c4e29f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788574529.707389:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681762432 00000100:00100000:1.0:1788574529.707399:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681762432 00000100:00100000:1.0:1788574529.707452:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788574529.707462:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+24:24953:x1875455681762432:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788574529.707509:0:22621:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788574529.707525:0:22621:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788574529.728057:0:22621:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788574529.728077:0:22621:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788574529.728246:0:22643:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788574529.728253:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788574529.728473:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85f7ac9200/0x5bf8706fdac8dd67 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574529.728490:0:22643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d20d6200/0x5bf8706fdac8dbf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8dbed expref: 24 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574529.728499:0:22643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8dc02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8dbfb expref: 24 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574529.728507:0:22643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85f7ac9200/0x5bf8706fdac8dd67 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574529.728541:0:22643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8dc02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8dbfb expref: 24 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574529.728554:0:22643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8dc02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8dbfb expref: 24 pid: 22621 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574529.728567:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22643:1875455681762560:0@lo:104: 00000100:00100000:3.0:1788574529.728606:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574529.728650:0:22643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d20d6200/0x5bf8706fdac8dbf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8dbed expref: 24 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574529.728659:0:22643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85d20d6200/0x5bf8706fdac8dbf4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8dbed expref: 24 pid: 22621 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574529.728667:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22643:1875455681762688:0@lo:104: 00000100:00100000:3.0:1788574529.728686:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574529.728698:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c376a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574529.728735:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681762560 00000100:00100000:3.0:1788574529.728741:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681762560 00000100:00100000:3.0:1788574529.728777:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681762688 00000100:00100000:3.0:1788574529.728779:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681762688 00000100:00100000:3.0:1788574529.728790:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574529.728796:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+4:22643:x1875455681762560:12345-0@lo:104: 00010000:00010000:3.0:1788574529.728809:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8dbfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8dc02 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574529.728862:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574529.728868:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+4:22643:x1875455681762560:12345-0@lo:104: Request processed in 72us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574529.728876:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574529.728892:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574529.728897:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+3:22643:x1875455681762688:12345-0@lo:104: 00010000:00010000:3.0:1788574529.728904:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e200/0x5bf8706fdac8dbed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8dbf4 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574529.728929:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788574529.728934:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+3:22643:x1875455681762688:12345-0@lo:104: Request processed in 38us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574529.728939:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574529.728968:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22643:1875455681762560:0@lo:104: 00000100:00100000:3.0:1788574529.728975:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22643:1875455681762688:0@lo:104: 00010000:00010000:3.0:1788574529.728995:0:22643:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85f7ac9200/0x5bf8706fdac8dd67 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574529.729738:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+24:24953:x1875455681762432:12345-0@lo:253:mount.lustre.0 Request processed in 22259us (22611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574529.729749:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00010000:1.0:1788574529.729794:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574529.729800:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8dbfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8dc02 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.729808:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f400 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574529.729812:0:23782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8dbfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8dc02 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.729820:0:23782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8dbfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8dc02 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574529.729844:0:23782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8dbfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8dc02 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574529.729851:0:23782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788574529.729894:0:23782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8dbfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8dc02 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.729900:0:23782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574529.729923:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8dbfb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8dc02 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.729930:0:23782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8dbfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8dc02 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.729943:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574529.729946:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e200/0x5bf8706fdac8dbed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8dbf4 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.729951:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e200 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574529.729954:0:23782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e200/0x5bf8706fdac8dbed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8dbf4 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.729960:0:23782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e200/0x5bf8706fdac8dbed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8dbf4 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574529.729967:0:23782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e200/0x5bf8706fdac8dbed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8dbf4 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574529.729971:0:23782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788574529.729992:0:23782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e200/0x5bf8706fdac8dbed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8dbf4 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.729999:0:23782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574529.730005:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e200/0x5bf8706fdac8dbed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8dbf4 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730013:0:23782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e200/0x5bf8706fdac8dbed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8dbf4 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730026:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574529.730027:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574529.730029:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574529.730036:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574529.730049:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a90d265-af03-4b80-95da-0de9cffed3f2:3619:1875455681762816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574529.730085:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574529.730112:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574529.730118:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a90d265-af03-4b80-95da-0de9cffed3f2:3619:1875455681762944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574529.730135:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574529.730163:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681762816 00000100:00100000:1.0:1788574529.730169:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681762816 00010000:00010000:1.0:1788574529.730213:0:22614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8dc02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8dbfb expref: 24 pid: 22621 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574529.730246:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681762944 00000100:00100000:1.0:1788574529.730250:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681762944 00010000:00010000:1.0:1788574529.730264:0:22614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d20d6200/0x5bf8706fdac8dbf4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8dbed expref: 25 pid: 22621 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574529.730290:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788574529.730298:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a90d265-af03-4b80-95da-0de9cffed3f2+25:3619:x1875455681762816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574529.730316:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574529.730322:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8dc02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8dbfb expref: 25 pid: 22621 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730332:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8dc02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8dbfb expref: 25 pid: 22621 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730345:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8dc02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8dbfb expref: 25 pid: 22621 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730364:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574529.730395:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a90d265-af03-4b80-95da-0de9cffed3f2+24:3619:x1875455681762816:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574529.730402:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788574529.730416:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788574529.730423:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a90d265-af03-4b80-95da-0de9cffed3f2+23:3619:x1875455681762944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574529.730430:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574529.730434:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d20d6200/0x5bf8706fdac8dbf4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8dbed expref: 23 pid: 22621 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730442:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d20d6200/0x5bf8706fdac8dbf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8dbed expref: 23 pid: 22621 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730451:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d20d6200/0x5bf8706fdac8dbf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8dbed expref: 23 pid: 22621 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730461:0:22614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85f7ac9200/0x5bf8706fdac8dd67 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730469:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85f7ac9200/0x5bf8706fdac8dd67 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788574529.730489:0:22614:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005426108s 00010000:00010000:1.0:1788574529.730494:0:22614:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85f7ac9200/0x5bf8706fdac8dd67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730500:0:22614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85f7ac9200/0x5bf8706fdac8dd67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730505:0:22614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85f7ac9200/0x5bf8706fdac8dd67 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730512:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85f7ac9200/0x5bf8706fdac8dd67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730517:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac9200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574529.730521:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85f7ac9200/0x5bf8706fdac8dd67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730529:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85f7ac9200/0x5bf8706fdac8dd67 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730543:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85f7ac9200/0x5bf8706fdac8dd67 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730552:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574529.730575:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a90d265-af03-4b80-95da-0de9cffed3f2+22:3619:x1875455681762944:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574529.730582:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788574529.730616:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a90d265-af03-4b80-95da-0de9cffed3f2:3619:1875455681762944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574529.730624:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a90d265-af03-4b80-95da-0de9cffed3f2:3619:1875455681762816:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574529.730656:0:22643:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85f7ac9200/0x5bf8706fdac8dd67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730665:0:22643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85f7ac9200/0x5bf8706fdac8dd67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574529.730671:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85f7ac9200/0x5bf8706fdac8dd67 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574529.732502:0:24953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3727100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7a90d265-af03-4b80-95da-0de9cffed3f2:24953:1875455681762432:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788574529.732522:0:24953:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788574529.732525:0:24953:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788574529.732527:0:24953:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788574529.732528:0:24953:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574529.732529:0:24953:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574529.732531:0:24953:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574529.732532:0:24953:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574529.732533:0:24953:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574529.732535:0:24953:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574529.732536:0:24953:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788574529.732554:0:24953:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1788574529.735049:0:24953:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788574529.750053:0:24953:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788574529.750063:0:24953:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788574529.750115:0:24953:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788574529.750167:0:24953:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788574529.750185:0:24953:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788574529.750239:0:24953:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788574529.751093:0:24953:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788574529.751402:0:24953:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788574530.067580:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788574530.771442:0:22624:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788574530.771451:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85fa0fa800 from 14 10000000:01000000:3.0:1788574530.771457:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788574530.771507:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85f7ac8000/0x5bf8706fdac8dd6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574530.771519:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85f7ac8000/0x5bf8706fdac8dd6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574530.771531:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85f7ac8000/0x5bf8706fdac8dd6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574530.771556:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681763072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574530.771621:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574530.771663:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c376ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574530.771692:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681763072 00000100:00100000:3.0:1788574530.771711:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681763072 00000100:00100000:3.0:1788574530.771771:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788574530.771780:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+22:22624:x1875455681763072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574530.771793:0:22619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574530.772649:0:22619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85f7ac8200/0x5bf8706fdac8dd75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8dd6e expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574530.772680:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85f7ac8200/0x5bf8706fdac8dd75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8dd6e expref: 23 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574530.772692:0:22619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85f7ac8200/0x5bf8706fdac8dd75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8dd6e expref: 23 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574530.772713:0:22619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85f7ac8200, rc 0) 00000100:00100000:3.0:1788574530.772968:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+23:22624:x1875455681763072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1187us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574530.772976:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788574530.773089:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681763072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574530.773107:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85f7ac8000/0x5bf8706fdac8dd6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dd75 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574530.773139:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85f7ac8000/0x5bf8706fdac8dd6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8dd75 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574530.773238:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681763200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788574530.773285:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574530.773311:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c250f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574530.773748:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681763200 00000100:00100000:1.0:1788574530.773756:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681763200 00000100:00100000:1.0:1788574530.773804:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788574530.773814:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+23:22624:x1875455681763200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788574530.773833:0:22621:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788574530.773849:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788574530.773853:0:22621:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788574530.773944:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+23:22624:x1875455681763200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574530.773950:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788574530.774052:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681763200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788574530.774115:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788574530.774122:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85f7ac8000/0x5bf8706fdac8dd6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dd75 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574530.774131:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85f7ac8000/0x5bf8706fdac8dd6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dd75 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574530.774140:0:22624:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788574530.774143:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c84c2291800 from 14 10000000:01000000:2.0:1788574530.774146:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788574530.774167:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e400/0x5bf8706fdac8dd7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574530.774176:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e400/0x5bf8706fdac8dd7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574530.774229:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e400/0x5bf8706fdac8dd7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574530.774244:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681763328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574530.774271:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574530.774296:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c250f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788574530.774347:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681763328 00000100:00100000:3.0:1788574530.774352:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681763328 00000100:00100000:3.0:1788574530.774375:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788574530.774382:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+23:22624:x1875455681763328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574530.774390:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574530.774400:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85f7ac8a00/0x5bf8706fdac8dd83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8dd7c expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574530.774418:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85f7ac8a00/0x5bf8706fdac8dd83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8dd7c expref: 24 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574530.774427:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85f7ac8a00/0x5bf8706fdac8dd83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8dd7c expref: 24 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574530.774435:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85f7ac8a00, rc 0) 00000100:00100000:3.0:1788574530.774472:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+24:22624:x1875455681763328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574530.774478:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788574530.774532:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681763328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574530.774543:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e400/0x5bf8706fdac8dd7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dd83 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574530.774550:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e400/0x5bf8706fdac8dd7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8dd83 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574530.774587:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681763456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788574530.774612:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574530.774631:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c250f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788574530.774665:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681763456 00000100:00100000:3.0:1788574530.774670:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681763456 00000100:00100000:3.0:1788574530.774712:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788574530.774718:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+24:22624:x1875455681763456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788574530.774729:0:22619:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788574530.774740:0:22619:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788574530.774743:0:22619:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788574530.774801:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+24:22624:x1875455681763456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 83us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574530.774808:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788574530.774908:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681763456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788574530.774943:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788574530.774948:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e400/0x5bf8706fdac8dd7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dd83 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574530.774956:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e400/0x5bf8706fdac8dd7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8dd83 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:0.0:1788574530.780606:0:25019:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788574530.780871:0:25019:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788574531.099782:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574532.117966:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574532.244414:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574532.244434:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681763584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574532.244505:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574532.245433:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681763584 00000100:00100000:1.0:1788574532.245444:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681763584 00000100:00100000:1.0:1788574532.245527:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574532.245535:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681763584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574532.245566:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788574532.245626:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681763584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574532.245633:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574532.245696:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681763584:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788574532.245769:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574532.755599:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574532.755622:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681763712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574532.755704:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574532.755752:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681763712 00000100:00100000:0.0:1788574532.755760:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681763712 00000100:00100000:0.0:1788574532.755816:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788574532.755826:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681763712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574532.755863:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788574532.755909:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681763712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574532.755916:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788574532.755962:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681763712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574532.756149:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574532.756160:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681763840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574532.756207:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574532.756678:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681763840 00000100:00100000:0.0:1788574532.756684:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681763840 00000100:00100000:0.0:1788574532.756712:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788574532.756719:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681763840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574532.756744:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788574532.756785:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681763840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574532.756791:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788574532.756822:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681763840:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788574533.143049:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574533.267396:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574533.267422:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681763968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574533.267490:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574533.267535:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681763968 00000100:00100000:1.0:1788574533.267542:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681763968 00000100:00100000:1.0:1788574533.267594:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788574533.267603:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681763968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574533.267625:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788574533.267677:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681763968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574533.267683:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788574533.267703:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574533.267738:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681763968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788574534.163451:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574534.805207:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574534.805222:0:470:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788574534.805226:0:470:0:(import.c:65:import_set_state_nolock()) ffff9c85f6de8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574534.805238:0:470:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c85f6de8000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574534.805262:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c2337480 x1875455681764480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788574534.805299:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574534.805301:0:470:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788574534.805303:0:470:0:(import.c:65:import_set_state_nolock()) ffff9c84c369d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574534.805307:0:470:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c84c369d800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574534.805316:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c2335f80 x1875455681764992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574534.805394:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a90d265-af03-4b80-95da-0de9cffed3f2:3617:1875455681764096:0@lo:400:kworker.0 00000100:00100000:2.0:1788574534.805464:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574534.805521:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681764736:0@lo:400:kworker.0 00000100:00100000:2.0:1788574534.805548:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574534.805568:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681765376:0@lo:400:kworker.0 00000100:00100000:2.0:1788574534.805612:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574534.805649:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788574534.805655:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681764224:0@lo:400:kworker.0 00000100:00100000:2.0:1788574534.807159:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574534.807215:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681764864:0@lo:400:kworker.0 00000100:00100000:2.0:1788574534.807239:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574534.807259:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681765504:0@lo:400:kworker.0 00000100:00100000:2.0:1788574534.807287:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574534.807341:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681764352:0@lo:400:kworker.0 00000100:00100000:2.0:1788574534.807368:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574534.807386:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681765120:0@lo:400:kworker.0 00000100:00100000:2.0:1788574534.807406:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574534.807425:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681765632:0@lo:400:kworker.0 00000100:00100000:2.0:1788574534.807451:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574534.807473:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788574534.807480:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681764608:0@lo:400:kworker.0 00000100:00100000:2.0:1788574534.807499:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574534.807514:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681765248:0@lo:400:kworker.0 00000100:00100000:2.0:1788574534.807533:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574534.807557:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681764480:0@lo:8:kworker.0 00000100:00100000:2.0:1788574534.807583:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574534.807600:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681764992:0@lo:8:kworker.0 00000100:00100000:2.0:1788574534.807632:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574534.809091:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681764096 00000100:00100000:2.0:1788574534.809103:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681764096 00000100:00100000:2.0:1788574534.809208:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788574534.809219:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+24:3617:x1875455681764096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574534.809293:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+24:3617:x1875455681764096:12345-0@lo:400:kworker.0 Request processed in 77us (3828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574534.809301:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788574534.817331:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681764864 00000100:00100000:0.0:1788574534.817351:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681764864 00000100:00100000:0.0:1788574534.817431:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681764352 00000100:00100000:0.0:1788574534.817434:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681764352 00000100:00100000:0.0:1788574534.817445:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681764480 00000100:00100000:0.0:1788574534.817448:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681764480 00000100:00100000:0.0:1788574534.817456:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681764992 00000100:00100000:0.0:1788574534.817459:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681764992 00000100:00100000:0.0:1788574534.817472:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574534.817481:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681764864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574534.817577:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681764864:12345-0@lo:400:kworker.0 Request processed in 96us (10335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574534.817593:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574534.817609:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574534.817616:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681764352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574534.817753:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681764352:12345-0@lo:400:kworker.0 Request processed in 137us (10383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574534.817761:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574534.817774:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574534.817778:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3616:x1875455681764480:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788574534.817811:0:24138:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:0.0:1788574534.817845:0:24138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8dd8a 00002000:00100000:0.0:1788574534.817861:0:24138:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c85f6f41000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788574534.817864:0:24138:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788574534.817868:0:24138:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788574534.818866:0:24138:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788574534.818900:0:24138:0:(import.c:65:import_set_state_nolock()) ffff9c85f6f45800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574534.818980:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1875455681764480:12345-0@lo:8:kworker.0 Request processed in 1198us (11394us total) trans 0 rc 0/0 00000100:00080000:3.0:1788574534.819122:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574534.819158:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574534.819217:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574534.819225:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3616:x1875455681764992:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788574534.819253:0:24138:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:0.0:1788574534.819276:0:24138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8dd91 00002000:00100000:0.0:1788574534.819288:0:24138:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9c85f6f46000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788574534.819291:0:24138:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788574534.819299:0:24138:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788574534.819347:0:24138:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788574534.819362:0:24138:0:(import.c:65:import_set_state_nolock()) ffff9c85c368e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574534.819397:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1875455681764992:12345-0@lo:8:kworker.0 Request processed in 171us (11763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574534.819403:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574534.819426:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681765376 00000100:00100000:0.0:1788574534.819431:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681765376 00000100:00100000:0.0:1788574534.819468:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681765504 00000100:00100000:0.0:1788574534.819471:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681765504 00000100:00100000:0.0:1788574534.819485:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681765120 00000100:00100000:0.0:1788574534.819488:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681765120 00000100:00100000:0.0:1788574534.819498:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681765632 00000100:00100000:0.0:1788574534.819501:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681765632 00000100:00100000:0.0:1788574534.819513:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681764608 00000100:00100000:0.0:1788574534.819516:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681764608 00000100:00100000:0.0:1788574534.819525:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681765248 00000100:00100000:0.0:1788574534.819528:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681765248 00000100:00100000:0.0:1788574534.819543:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574534.819549:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681765376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574534.819584:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681765376:12345-0@lo:400:kworker.0 Request processed in 36us (13972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574534.819590:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574534.819603:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788574534.819608:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681765504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574534.819648:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681765504:12345-0@lo:400:kworker.0 Request processed in 40us (12360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574534.819654:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788574534.820032:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574534.820036:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788574534.821602:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681764352:0@lo:400:kworker.0 00010000:00080000:2.0:1788574534.821680:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c2337480 x1875455681764480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574534.821712:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788574534.821722:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788574534.821728:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788574534.821732:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85f6de8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788574534.821752:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788574534.821758:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681764480:0@lo:8:kworker.0 00010000:00080000:2.0:1788574534.821774:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c2335f80 x1875455681764992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574534.821783:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788574534.821788:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788574534.821791:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788574534.821793:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c369d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788574534.821807:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788574534.821810:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681764992:0@lo:8:kworker.0 00000100:00100000:2.0:1788574534.821848:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681764864:0@lo:400:kworker.0 00010000:00080000:2.0:1788574534.821862:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c22f9c00 x1875455681765504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574534.821871:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681765504:0@lo:400:kworker.0 00000100:00100000:2.0:1788574534.821882:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a90d265-af03-4b80-95da-0de9cffed3f2:3617:1875455681764096:0@lo:400:kworker.0 00010000:00080000:2.0:1788574534.821893:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c22f8e00 x1875455681765376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574534.821900:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681765376:0@lo:400:kworker.0 00000004:00080000:1.0:1788574534.825023:0:22653:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788574534.825556:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788574534.825579:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681765120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574534.825705:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681765120:12345-0@lo:400:kworker.0 Request processed in 136us (18297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574534.825715:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788574534.825753:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788574534.825761:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681765632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574534.825793:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681765632:12345-0@lo:400:kworker.0 Request processed in 34us (18341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574534.825799:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788574534.825812:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788574534.825818:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681764608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574534.825848:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681764608:12345-0@lo:400:kworker.0 Request processed in 31us (18348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574534.825854:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788574534.825865:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788574534.825872:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681765248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574534.825899:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681765248:12345-0@lo:400:kworker.0 Request processed in 28us (18365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574534.825905:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000004:00080000:3.0:1788574534.825959:0:22654:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1788574534.825982:0:22654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22654:1875455681765888:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788574534.826047:0:22654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574534.826072:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e0a253c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574534.826089:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681765760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574534.826165:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574534.826219:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681765760 00000100:00100000:3.0:1788574534.826228:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681765760 00000100:00100000:3.0:1788574534.826272:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574534.826279:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681765760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574534.826319:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788574534.826357:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681765760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574534.826364:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788574534.826399:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c0bb80 x1875455681765760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574534.826420:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681765760:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788574534.826442:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788574534.826462:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c2334000 x1875455681764608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574534.826471:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681764608:0@lo:400:kworker.0 00010000:00080000:3.0:1788574534.826482:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c2334700 x1875455681765248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574534.826490:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681765248:0@lo:400:kworker.0 00010000:00080000:3.0:1788574534.826501:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c2336a00 x1875455681765120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574534.826521:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681765120:0@lo:400:kworker.0 00010000:00080000:3.0:1788574534.826538:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c22f8000 x1875455681765632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574534.826547:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681765632:0@lo:400:kworker.0 00000100:00100000:3.0:1788574534.826574:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681765888 00000100:00100000:3.0:1788574534.826578:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681765888 00000100:00100000:3.0:1788574534.826601:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788574534.826608:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22654:x1875455681765888:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788574534.827328:0:22653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 674807136770ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788574534.827344:0:22653:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788574534.827405:0:23371:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788574534.827425:0:23371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23371:1875455681766144:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788574534.827469:0:23371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574534.827490:0:23371:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85f6f2d6c0 going to sleep for 11 seconds 00000004:00080000:1.0:1788574534.829634:0:22607:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788574534.830116:0:24616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681766144 00000100:00100000:0.0:1788574534.830134:0:24616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681766144 00000100:00100000:0.0:1788574534.830213:0:24616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574534.830223:0:24616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23371:x1875455681766144:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788574534.830282:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681764736 00000100:00100000:0.0:1788574534.830286:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681764736 00000100:00100000:0.0:1788574534.830313:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681764224 00000100:00100000:0.0:1788574534.830316:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681764224 00000100:00100000:0.0:1788574534.830329:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788574534.830335:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681764736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574534.830417:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681764736:12345-0@lo:400:kworker.0 Request processed in 81us (24868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574534.830424:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788574534.830441:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788574534.830447:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681764224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574534.830475:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681764224:12345-0@lo:400:kworker.0 Request processed in 28us (23318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574534.830481:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:0.0:1788574534.830507:0:23370:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788574534.830591:0:23370:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674810400555ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788574534.830598:0:23370:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:3.0:1788574534.831531:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574534.832299:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681766016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574534.832364:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574534.832420:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681764224:0@lo:400:kworker.0 00000100:00100000:3.0:1788574534.832434:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681764736:0@lo:400:kworker.0 00000100:00100000:3.0:1788574534.832492:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681766016 00000100:00100000:3.0:1788574534.832498:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681766016 00000100:00100000:3.0:1788574534.832543:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574534.832552:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3617:x1875455681766016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788574534.832577:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788574534.832636:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3617:x1875455681766016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574534.832644:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788574534.833113:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf5ce00 x1875455681766016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574534.833145:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681766016:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1788574534.842439:0:23358:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788574534.842533:0:24138:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788574534.842542:0:24138:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1788574534.842548:0:24138:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:3.0:1788574534.848464:0:24616:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788574534.848474:0:24616:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788574534.848562:0:24616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23371:x1875455681766144:12345-0@lo:7:osp-pre-1-1.0 Request processed in 18337us (21088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574534.848574:0:24616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788574534.848641:0:23371:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf5d500 x1875455681766144/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788574550 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574534.850283:0:23371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23371:1875455681766144:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788574534.850306:0:23371:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788574534.850354:0:23371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23371:1875455681766272:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788574534.850415:0:23371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574534.850442:0:23371:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e0a25600 going to sleep for 11 seconds 00000100:00100000:3.0:1788574534.850477:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681766272 00000100:00100000:3.0:1788574534.850484:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681766272 00000100:00100000:3.0:1788574534.850527:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788574534.850535:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23371:x1875455681766272:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788574534.850561:0:24137:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788574534.850594:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23371:x1875455681766272:12345-0@lo:5:osp-pre-1-1.0 Request processed in 60us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574534.850600:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788574534.850643:0:23371:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be2680 x1875455681766272/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574550 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574534.852094:0:23371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23371:1875455681766272:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788574534.852132:0:23371:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788574534.852203:0:23371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23371:1875455681766400:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788574534.852249:0:23371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574534.852279:0:23371:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e0a25600 going to sleep for 11 seconds 00000100:00100000:3.0:1788574534.852306:0:24616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681766400 00000100:00100000:3.0:1788574534.852311:0:24616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681766400 00000100:00100000:3.0:1788574534.852349:0:24616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788574534.852356:0:24616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23371:x1875455681766400:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788574534.852390:0:24616:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:3.0:1788574534.868609:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574534.868629:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096e94797/0x5bf8706fdac8dd98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.868647:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1788574534.868652:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574534.868667:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096e94797/0x5bf8706fdac8dd98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.868686:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096e94797/0x5bf8706fdac8dd98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.868697:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096e94797/0x5bf8706fdac8dd98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.868704:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096e94797/0x5bf8706fdac8dd98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.868731:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574534.869211:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574534.869220:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096e94797/0x5bf8706fdac8dd98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.869229:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac9a00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574534.869234:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096e94797/0x5bf8706fdac8dd98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.869243:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096e94797/0x5bf8706fdac8dd98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.869264:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096e94797/0x5bf8706fdac8dd98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.869272:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096e94797/0x5bf8706fdac8dd98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.869291:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574534.869300:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574534.869302:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574534.870344:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574534.870356:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dd477b8/0x5bf8706fdac8dd9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.870371:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1788574534.870375:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574534.870381:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dd477b8/0x5bf8706fdac8dd9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.870393:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dd477b8/0x5bf8706fdac8dd9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.870403:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dd477b8/0x5bf8706fdac8dd9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.870411:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dd477b8/0x5bf8706fdac8dd9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.870430:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574534.870597:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574534.870604:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dd477b8/0x5bf8706fdac8dd9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.870612:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac8800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574534.870616:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dd477b8/0x5bf8706fdac8dd9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.870636:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dd477b8/0x5bf8706fdac8dd9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.870652:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dd477b8/0x5bf8706fdac8dd9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.870671:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dd477b8/0x5bf8706fdac8dd9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.870688:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574534.870690:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574534.870691:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574534.871589:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574534.871599:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a5b509e/0x5bf8706fdac8dda6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.871611:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1788574534.871636:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574534.871641:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a5b509e/0x5bf8706fdac8dda6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.871652:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a5b509e/0x5bf8706fdac8dda6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.871672:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a5b509e/0x5bf8706fdac8dda6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.871680:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a5b509e/0x5bf8706fdac8dda6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.871704:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574534.872337:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574534.872346:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a5b509e/0x5bf8706fdac8dda6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.872356:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac9c00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574534.872360:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a5b509e/0x5bf8706fdac8dda6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.872377:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a5b509e/0x5bf8706fdac8dda6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.872394:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a5b509e/0x5bf8706fdac8dda6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.872402:0:23782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a5b509e/0x5bf8706fdac8dda6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.872421:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574534.872422:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574534.872424:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574534.873022:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.873030:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000884dd2e/0x5bf8706fdac8ddad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.873042:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.873047:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.873052:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000884dd2e/0x5bf8706fdac8ddad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.873063:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000884dd2e/0x5bf8706fdac8ddad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.873072:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000884dd2e/0x5bf8706fdac8ddad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.873085:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000884dd2e/0x5bf8706fdac8ddad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.873103:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788574534.873553:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.873559:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8ddb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.873567:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.873570:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.873574:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8ddb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.873582:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8ddb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.873589:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8ddb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.873596:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8ddb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.873642:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788574534.873956:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.873961:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042f2db3d/0x5bf8706fdac8ddbb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.873975:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.873978:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.873981:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042f2db3d/0x5bf8706fdac8ddbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874056:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042f2db3d/0x5bf8706fdac8ddbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874065:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042f2db3d/0x5bf8706fdac8ddbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874072:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042f2db3d/0x5bf8706fdac8ddbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874088:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788574534.874098:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788574534.874103:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000884dd2e/0x5bf8706fdac8ddad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874110:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574534.874115:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000884dd2e/0x5bf8706fdac8ddad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874123:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000884dd2e/0x5bf8706fdac8ddad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874150:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000884dd2e/0x5bf8706fdac8ddad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874157:0:23782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000884dd2e/0x5bf8706fdac8ddad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874263:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574534.874268:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8ddb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874275:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a3a00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574534.874278:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8ddb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874286:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8ddb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874298:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8ddb4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874305:0:23782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8ddb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874316:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574534.874318:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042f2db3d/0x5bf8706fdac8ddbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874330:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2e00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574534.874333:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042f2db3d/0x5bf8706fdac8ddbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874341:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042f2db3d/0x5bf8706fdac8ddbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874352:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042f2db3d/0x5bf8706fdac8ddbb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874359:0:23782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042f2db3d/0x5bf8706fdac8ddbb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874372:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574534.874374:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574534.874375:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574534.874670:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574534.874800:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.874806:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7afc5fc/0x5bf8706fdac8ddc2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874816:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.874820:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.874825:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7afc5fc/0x5bf8706fdac8ddc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874834:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7afc5fc/0x5bf8706fdac8ddc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874851:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7afc5fc/0x5bf8706fdac8ddc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874859:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7afc5fc/0x5bf8706fdac8ddc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.874883:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574534.875230:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574534.875236:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7afc5fc/0x5bf8706fdac8ddc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.875244:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a3c00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574534.875247:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7afc5fc/0x5bf8706fdac8ddc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.875256:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7afc5fc/0x5bf8706fdac8ddc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.875272:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7afc5fc/0x5bf8706fdac8ddc2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.875279:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7afc5fc/0x5bf8706fdac8ddc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.875296:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.875298:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.875299:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574534.875562:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574534.875849:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.875855:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ca0681a/0x5bf8706fdac8ddc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.875866:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.875869:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.875874:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ca0681a/0x5bf8706fdac8ddc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.875884:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ca0681a/0x5bf8706fdac8ddc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.875892:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ca0681a/0x5bf8706fdac8ddc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.875900:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ca0681a/0x5bf8706fdac8ddc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.875974:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788574534.877969:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.877981:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8ddd0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.878010:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.878014:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.878020:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8ddd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.878031:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8ddd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.878040:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8ddd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.878047:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8ddd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.880785:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574534.880798:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ca0681a/0x5bf8706fdac8ddc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.880812:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574534.880817:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ca0681a/0x5bf8706fdac8ddc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.880828:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ca0681a/0x5bf8706fdac8ddc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.880847:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ca0681a/0x5bf8706fdac8ddc9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.880867:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ca0681a/0x5bf8706fdac8ddc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.880891:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574534.880895:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8ddd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.880902:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574534.880906:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8ddd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.880914:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8ddd0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.880924:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8ddd0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574534.880932:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574534.880933:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574534.880935:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574534.883364:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788574534.883378:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8ddd0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574534.887789:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.887805:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8ddd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.887828:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.887833:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.887839:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8ddd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.887855:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8ddd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.887866:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8ddd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.887874:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8ddd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788574534.889342:0:24954:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1788574534.889367:0:24954:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788574534.889372:0:24954:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788574534.889519:0:24616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23371:x1875455681766400:12345-0@lo:5:osp-pre-1-1.0 Request processed in 37158us (37263us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788574534.889529:0:24616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788574534.889636:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574534.889644:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8ddd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.889724:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574534.889729:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8ddd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.889756:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8ddd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.889774:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8ddd7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.889783:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.889785:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.889786:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574534.889892:0:23371:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788574534.889901:0:23371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23371:1875455681766400:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788574534.889916:0:23371:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1788574534.889966:0:23371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23371:1875455681766528:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788574534.890091:0:23371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574534.890114:0:23371:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e0a25600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574534.890827:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681766528 00000100:00100000:0.0:1788574534.890837:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681766528 00000100:00100000:0.0:1788574534.890886:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574534.890895:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23371:x1875455681766528:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788574534.890957:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23371:x1875455681766528:12345-0@lo:900:osp-pre-1-1.0 Request processed in 64us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574534.890964:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788574534.891070:0:23371:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be2680 x1875455681766528/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788574550 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574534.891083:0:23371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23371:1875455681766528:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1788574534.891827:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788574534.891840:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8ddd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.892237:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574534.892651:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.892671:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8ddde lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.892685:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.892690:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.892697:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8ddde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.892725:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8ddde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.892734:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8ddde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.892741:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8ddde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.892765:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574534.892929:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574534.892935:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8ddde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.892943:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616a00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574534.892954:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8ddde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.892964:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8ddde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.892980:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8ddde lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.892997:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8ddde lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.893018:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.893020:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.893022:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574534.893422:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.893429:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0aadbf8/0x5bf8706fdac8dde5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.893439:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.893441:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.893446:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0aadbf8/0x5bf8706fdac8dde5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.893455:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0aadbf8/0x5bf8706fdac8dde5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.893463:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0aadbf8/0x5bf8706fdac8dde5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.893481:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0aadbf8/0x5bf8706fdac8dde5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.893502:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574534.893800:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574534.893806:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0aadbf8/0x5bf8706fdac8dde5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.893814:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617600 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574534.893817:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0aadbf8/0x5bf8706fdac8dde5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.893825:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0aadbf8/0x5bf8706fdac8dde5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.893837:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0aadbf8/0x5bf8706fdac8dde5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.893852:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0aadbf8/0x5bf8706fdac8dde5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.893868:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.893870:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.893872:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574534.893940:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.893947:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000088916b2/0x5bf8706fdac8ddec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.893955:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.893959:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.893963:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000088916b2/0x5bf8706fdac8ddec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.893972:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000088916b2/0x5bf8706fdac8ddec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.893980:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000088916b2/0x5bf8706fdac8ddec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.894046:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000088916b2/0x5bf8706fdac8ddec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.894068:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574534.894266:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574534.894272:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000088916b2/0x5bf8706fdac8ddec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.894280:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574534.894283:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000088916b2/0x5bf8706fdac8ddec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.894292:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000088916b2/0x5bf8706fdac8ddec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.894302:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000088916b2/0x5bf8706fdac8ddec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.894309:0:23782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000088916b2/0x5bf8706fdac8ddec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.894322:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.894324:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.894325:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574534.894482:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.894488:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec2311be/0x5bf8706fdac8ddf3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.894501:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.894504:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.894508:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec2311be/0x5bf8706fdac8ddf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.894517:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec2311be/0x5bf8706fdac8ddf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.894525:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec2311be/0x5bf8706fdac8ddf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.894532:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec2311be/0x5bf8706fdac8ddf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.894582:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788574534.894964:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.894970:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8ddfa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.894979:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.894983:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.894997:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8ddfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.895008:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8ddfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.895028:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8ddfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.895035:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8ddfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.895355:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574534.895361:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec2311be/0x5bf8706fdac8ddf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.895369:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616600 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574534.895373:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec2311be/0x5bf8706fdac8ddf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.895382:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec2311be/0x5bf8706fdac8ddf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.895395:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec2311be/0x5bf8706fdac8ddf3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.895402:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec2311be/0x5bf8706fdac8ddf3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.895418:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574534.895421:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8ddfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.895426:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617e00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574534.895429:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8ddfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.895437:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8ddfa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.895456:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8ddfa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.895464:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.895465:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.895467:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574534.895644:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788574534.895650:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8ddfa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574534.896035:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.896042:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004459ae1f/0x5bf8706fdac8de01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.896052:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.896055:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.896060:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004459ae1f/0x5bf8706fdac8de01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.896070:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004459ae1f/0x5bf8706fdac8de01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.896078:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004459ae1f/0x5bf8706fdac8de01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.896097:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004459ae1f/0x5bf8706fdac8de01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.896108:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574534.896400:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574534.896406:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004459ae1f/0x5bf8706fdac8de01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.896414:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617a00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574534.896417:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004459ae1f/0x5bf8706fdac8de01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.896426:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004459ae1f/0x5bf8706fdac8de01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.896438:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004459ae1f/0x5bf8706fdac8de01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.896446:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004459ae1f/0x5bf8706fdac8de01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.896459:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.896460:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.896462:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.896472:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574534.897833:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.897843:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004297f6d4/0x5bf8706fdac8de08 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.897855:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.897859:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.897865:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004297f6d4/0x5bf8706fdac8de08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.897876:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004297f6d4/0x5bf8706fdac8de08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.897884:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004297f6d4/0x5bf8706fdac8de08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.897892:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004297f6d4/0x5bf8706fdac8de08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.897908:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788574534.898359:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.898365:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.898380:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.898384:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.898389:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.898398:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.898407:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.898414:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.898428:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788574534.898747:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.898753:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a5a947f/0x5bf8706fdac8de16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.898762:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.898765:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.898768:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a5a947f/0x5bf8706fdac8de16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.898777:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a5a947f/0x5bf8706fdac8de16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.898796:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a5a947f/0x5bf8706fdac8de16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.898803:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a5a947f/0x5bf8706fdac8de16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.898819:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788574534.899122:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.899128:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8de1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.899137:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.899140:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.899143:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8de1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.899153:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8de1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.899161:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8de1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.900067:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8de1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.900096:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788574534.901081:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788574534.901092:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004297f6d4/0x5bf8706fdac8de08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.901102:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616c00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574534.901107:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004297f6d4/0x5bf8706fdac8de08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.901116:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004297f6d4/0x5bf8706fdac8de08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.901134:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004297f6d4/0x5bf8706fdac8de08 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.901141:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004297f6d4/0x5bf8706fdac8de08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.901166:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788574534.901273:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574534.901286:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a5a947f/0x5bf8706fdac8de16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.901294:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616e00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574534.901297:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a5a947f/0x5bf8706fdac8de16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.901305:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a5a947f/0x5bf8706fdac8de16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.901316:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a5a947f/0x5bf8706fdac8de16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.901324:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a5a947f/0x5bf8706fdac8de16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.901339:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574534.901343:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8de1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.901350:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574534.901353:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8de1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.901361:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8de1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.901381:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8de1d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.901388:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8de1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.901402:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.901404:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.901407:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.901446:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.901454:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574534.901457:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.901465:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.901483:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de0f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.901490:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.901504:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.901506:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.901508:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.901514:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574534.901661:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.901669:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8de24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.901681:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.901685:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.901691:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8de24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.901701:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8de24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.901709:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8de24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.901716:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8de24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.901773:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788574534.904307:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.904322:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.904340:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.904350:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.904357:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.904371:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.904381:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.904389:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.906934:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574534.906947:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8de24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.906960:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574534.906967:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8de24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.906979:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8de24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.907009:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8de24 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.907016:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8de24 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.907051:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574534.907055:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.907061:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574534.907064:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.907071:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de2b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.907081:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de2b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.907088:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.907090:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.907092:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574534.907363:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788574534.907372:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.907735:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574534.908445:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.908454:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8de32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.908469:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.908474:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.908481:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8de32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.908493:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8de32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.908511:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8de32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.908519:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8de32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.908544:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574534.908772:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574534.908779:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8de32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.908787:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617e00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574534.908791:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8de32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.908812:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8de32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.908829:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8de32 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.908837:0:23782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072f520bc/0x5bf8706fdac8de32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.908854:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.908856:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.908858:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574534.909028:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.909035:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8de39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.909043:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.909047:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.909051:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8de39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.909060:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8de39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.909069:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8de39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.909076:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8de39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.909140:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788574534.909729:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574534.909737:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8de40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.909747:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1788574534.909751:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574534.909755:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8de40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.909765:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8de40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.909773:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8de40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.909780:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8de40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.909838:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574534.909845:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8de39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.909853:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574534.909857:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8de39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.909866:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8de39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.909880:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8de39 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.909899:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a30cbbd1/0x5bf8706fdac8de39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.909914:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574534.909917:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8de40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.909923:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7c00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574534.909926:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8de40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.909935:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8de40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.909945:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8de40 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.909952:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.909954:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.909955:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.913523:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788574534.913539:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8de40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788574534.915380:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574534.915394:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bd503b8/0x5bf8706fdac8de47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.915412:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1788574534.915417:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574534.915424:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bd503b8/0x5bf8706fdac8de47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.915437:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bd503b8/0x5bf8706fdac8de47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.915448:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bd503b8/0x5bf8706fdac8de47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.915456:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bd503b8/0x5bf8706fdac8de47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.915678:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574534.915686:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bd503b8/0x5bf8706fdac8de47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.915695:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574534.915708:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bd503b8/0x5bf8706fdac8de47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.915719:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bd503b8/0x5bf8706fdac8de47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.915738:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bd503b8/0x5bf8706fdac8de47 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.915747:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.915749:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.915751:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.920027:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788574534.920044:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bd503b8/0x5bf8706fdac8de47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788574534.920674:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574534.920683:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d9e234f/0x5bf8706fdac8de4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.920698:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1788574534.920703:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574534.920710:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d9e234f/0x5bf8706fdac8de4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.920725:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d9e234f/0x5bf8706fdac8de4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.920736:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d9e234f/0x5bf8706fdac8de4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574534.920745:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d9e234f/0x5bf8706fdac8de4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.920856:0:23782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574534.920864:0:23782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d9e234f/0x5bf8706fdac8de4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.920873:0:23782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574534.920878:0:23782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d9e234f/0x5bf8706fdac8de4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.920887:0:23782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d9e234f/0x5bf8706fdac8de4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.920905:0:23782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d9e234f/0x5bf8706fdac8de4e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.920914:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.920924:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.920926:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574534.925048:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788574534.925063:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d9e234f/0x5bf8706fdac8de4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.925160:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574534.925885:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.925894:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.925910:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.925914:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.925920:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.925934:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.925945:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.925953:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.926014:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788574534.926331:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.926337:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8de5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.926346:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.926354:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.926359:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8de5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.926368:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8de5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.926376:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8de5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.926383:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8de5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.926547:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574534.926554:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.926562:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574534.926568:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.926576:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.926593:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de55 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.926601:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8caaebb/0x5bf8706fdac8de55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.926630:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574534.926634:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8de5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.926640:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617c00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574534.926643:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8de5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.926664:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8de5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.926675:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8de5c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574534.926683:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.926685:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.926688:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574534.926727:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788574534.926732:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8de5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574534.927054:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.927060:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8de63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927069:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.927072:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.927076:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8de63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927085:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8de63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927099:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8de63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927107:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8de63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927120:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788574534.927408:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574534.927414:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927422:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788574534.927425:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574534.927430:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927439:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927447:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927454:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927479:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788574534.927488:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574534.927492:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8de63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927499:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574534.927503:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8de63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927511:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8de63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927522:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8de63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927529:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8de63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927542:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574534.927545:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927552:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574534.927555:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927573:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927583:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de6a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927591:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f2bf9da/0x5bf8706fdac8de6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574534.927603:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574534.927604:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574534.927606:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788574534.927657:0:24138:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:1.0:1788574534.927758:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22654:x1875455681765888:12345-0@lo:5:osp-pre-1-0.0 Request processed in 101147us (101707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574534.927768:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574534.927820:0:22654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22654:1875455681765888:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788574534.927835:0:22654:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1788574534.927879:0:22654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22654:1875455681766656:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788574534.927914:0:22654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574534.927943:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85f7abea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574534.927960:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681766656 00000100:00100000:1.0:1788574534.927966:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681766656 00000100:00100000:1.0:1788574534.928004:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574534.928012:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22654:x1875455681766656:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788574534.928052:0:24138:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:1.0:1788574534.929974:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22654:x1875455681766656:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1956us (2052us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788574534.929986:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574534.930048:0:22654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22654:1875455681766656:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788574534.930062:0:22654:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:2.0:1788574534.930167:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574534.930175:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574535.187572:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788574535.510133:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788574536.217150:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788574537.090870:0:25309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788574537.238539:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574537.365789:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574537.365864:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681766784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574537.365957:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574537.366140:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681766784 00000100:00100000:3.0:1788574537.366149:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681766784 00000100:00100000:3.0:1788574537.366240:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574537.366251:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681766784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788574537.366284:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788574537.366330:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681766784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574537.366349:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788574537.366371:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574537.366408:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681766784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574537.875495:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681767040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574537.875606:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574537.875681:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574537.875688:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681766912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574537.875713:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574537.875779:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681767040 00000100:00100000:0.0:1788574537.875788:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681767040 00000100:00100000:0.0:1788574537.875836:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681766912 00000100:00100000:0.0:1788574537.875839:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681766912 00000100:00100000:0.0:1788574537.875856:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788574537.875864:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681767040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574537.875923:0:23367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788574537.875986:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681767040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574537.875993:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788574537.876010:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788574537.876016:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681766912:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574537.877292:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681767040:0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574537.877492:0:23367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788574537.877580:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681766912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1563us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574537.877588:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788574537.877925:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681766912:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1788574538.232945:0:25361:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788574538.233314:0:25361:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788574538.259966:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574538.388382:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681767168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574538.388473:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574538.388786:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681767168 00000100:00100000:0.0:1788574538.388794:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681767168 00000100:00100000:0.0:1788574538.389822:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788574538.389837:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681767168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574538.389863:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788574538.389948:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681767168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574538.389956:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788574538.390017:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681767168:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788574538.399851:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788574538.644992:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788574539.286321:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788574539.325633:0:25411:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788574539.326073:0:25411:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788574539.599641:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574539.599818:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669065344 00000100:00100000:0.0:1788574539.599853:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669065344 00000100:00100000:0.0:1788574539.599903:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:0.0:1788574539.599911:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2392:x1875455669065344:12345-192.168.204.51@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788574539.599940:0:22622:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc@192.168.204.51@tcp t0 exp 0000000000000000 cur 679 last 0 00000020:00000080:0.0:1788574539.599968:0:22622:0:(genops.c:1385:class_connect()) connect: client 736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc, cookie 0x5bf8706fdac8de71 00000100:00080000:0.0:1788574539.600115:0:22622:0:(import.c:65:import_set_state_nolock()) ffff9c85e0bc5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574539.600410:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+5:2392:x1875455669065344:12345-192.168.204.51@tcp:250:mount.lustre.0 Request processed in 497us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574539.600418:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:0.0:1788574539.614625:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574539.614784:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669065472 00000100:00100000:2.0:1788574539.614794:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669065472 00000100:00100000:2.0:1788574539.614902:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:2.0:1788574539.614912:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+5:18107:x1875455669065472:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788574539.614931:0:22619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574539.614948:0:22619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32f800/0x5bf8706fdac8de78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6d28 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574539.614979:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32f800/0x5bf8706fdac8de78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d28 expref: 6 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574539.615007:0:22619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32f800/0x5bf8706fdac8de78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d28 expref: 6 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574539.615017:0:22619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f800, rc 0) 00000100:00100000:2.0:1788574539.615081:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+6:18107:x1875455669065472:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 170us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574539.615088:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:2.0:1788574539.631726:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574539.631904:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669065600 00000100:00100000:0.0:1788574539.631916:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669065600 00000100:00100000:0.0:1788574539.631983:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:0.0:1788574539.631995:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+6:18107:x1875455669065600:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788574539.632128:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+6:18107:x1875455669065600:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 134us (413us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788574539.632137:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:3.0:1788574539.636737:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574539.638246:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669065728 00000100:00100000:2.0:1788574539.638262:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669065728 00000100:00100000:2.0:1788574539.638330:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:2.0:1788574539.638340:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+6:18107:x1875455669065728:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788574539.638358:0:22619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574539.638377:0:22619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32ec00/0x5bf8706fdac8de7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6d2f expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574539.638407:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32ec00/0x5bf8706fdac8de7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d2f expref: 7 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574539.638418:0:22619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32ec00/0x5bf8706fdac8de7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d2f expref: 7 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574539.638428:0:22619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32ec00, rc 0) 00000100:00100000:2.0:1788574539.638511:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+7:18107:x1875455669065728:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 172us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574539.638518:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:2.0:1788574539.643567:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574539.643806:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669065856 00000100:00100000:0.0:1788574539.643817:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669065856 00000100:00100000:0.0:1788574539.643873:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:0.0:1788574539.643883:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+7:18107:x1875455669065856:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788574539.644643:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+8:18107:x1875455669065856:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 759us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574539.644653:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:3.0:1788574539.650326:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574539.650412:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669065984 00000100:00100000:1.0:1788574539.650422:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669065984 00000100:00100000:1.0:1788574539.650496:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:1.0:1788574539.650507:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+8:18107:x1875455669065984:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788574539.650701:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+8:18107:x1875455669065984:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 195us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574539.650709:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:3.0:1788574539.654112:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574539.654229:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669066112 00000100:00100000:2.0:1788574539.654240:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669066112 00000100:00100000:2.0:1788574539.654288:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:2.0:1788574539.654297:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c6e1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+8:18126:x1875455669066112:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574539.654468:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c6e1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+8:18126:x1875455669066112:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 170us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574539.654476:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:0.0:1788574539.702916:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574539.703077:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669066240 00000100:00100000:2.0:1788574539.703089:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669066240 00000100:00100000:2.0:1788574539.703148:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:2.0:1788574539.703160:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c6e1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+8:18126:x1875455669066240:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574539.703356:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c6e1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+8:18126:x1875455669066240:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 198us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574539.703365:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:3.0:1788574539.709598:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574539.709831:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669066368 00000100:00100000:1.0:1788574539.709860:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669066368 00000100:00100000:1.0:1788574539.709938:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:1.0:1788574539.709948:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c6e1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+8:18126:x1875455669066368:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788574539.710105:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c6e1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+8:18126:x1875455669066368:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 158us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574539.710114:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:3.0:1788574539.735412:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574539.735811:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669066496 00000100:00100000:0.0:1788574539.735824:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669066496 00000100:00100000:0.0:1788574539.735884:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:0.0:1788574539.735895:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c6e1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+8:18107:x1875455669066496:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788574539.735913:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574539.735933:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d7800/0x5bf8706fdac8de86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6d60 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574539.735965:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d7800/0x5bf8706fdac8de86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d60 expref: 9 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574539.735978:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d7800/0x5bf8706fdac8de86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d60 expref: 9 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574539.735988:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7800, rc 0) 00000100:00100000:0.0:1788574539.736058:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c6e1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+9:18107:x1875455669066496:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 164us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574539.736065:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:0.0:1788574539.745036:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574539.745177:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669066624 00000100:00100000:2.0:1788574539.745232:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669066624 00000100:00100000:2.0:1788574539.745287:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:2.0:1788574539.745298:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c6e1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+9:18107:x1875455669066624:12345-192.168.204.51@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788574539.745326:0:22619:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788574539.745351:0:22619:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788574539.745355:0:22619:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788574539.745358:0:22619:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788574539.745362:0:22619:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788574539.745364:0:22619:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788574539.763006:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c6e1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+9:18107:x1875455669066624:12345-192.168.204.51@tcp:256:mount.lustre.0 Request processed in 17697us (17967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574539.764756:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:3.0:1788574539.769810:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574539.782387:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669066752 00000100:00100000:1.0:1788574539.782404:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669066752 00000100:00100000:1.0:1788574539.783843:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 126 00000100:00100000:1.0:1788574539.783862:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c6e1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+9:18107:x1875455669066752:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788574539.783879:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574539.783898:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c84c2617c00/0x5bf8706fdac8de8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6d67 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574539.783930:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c84c2617c00/0x5bf8706fdac8de8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d67 expref: 10 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574539.783943:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c84c2617c00/0x5bf8706fdac8de8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d67 expref: 10 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574539.783953:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617c00, rc 0) 00000100:00100000:1.0:1788574539.784836:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c6e1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+10:18107:x1875455669066752:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 979us (15035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574539.784847:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 126 00000100:00100000:0.0:1788574539.794660:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574539.794808:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669066880 00000100:00100000:2.0:1788574539.794818:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669066880 00000100:00100000:2.0:1788574539.795029:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00100000:2.0:1788574539.795041:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c6e1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+10:18107:x1875455669066880:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788574539.795231:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c6e1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+10:18107:x1875455669066880:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 191us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574539.795238:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00100000:3.0:1788574539.805145:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574539.809654:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669067008 00000100:00100000:1.0:1788574539.809671:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669067008 00000100:00100000:0.0:1788574539.811503:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:0.0:1788574539.811520:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+10:18107:x1875455669067008:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788574539.811868:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+10:18107:x1875455669067008:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 351us (6749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574539.811877:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:3.0:1788574539.820597:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574539.821798:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669067136 00000100:00100000:2.0:1788574539.821812:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669067136 00000100:00100000:2.0:1788574539.821926:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00100000:2.0:1788574539.821938:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+10:18130:x1875455669067136:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574539.822122:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+10:18130:x1875455669067136:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 185us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574539.822130:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00100000:0.0:1788574539.825745:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574539.835016:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669067264 00000100:00100000:1.0:1788574539.835038:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669067264 00000100:00100000:1.0:1788574539.835121:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 130 00000100:00100000:1.0:1788574539.835161:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+10:18130:x1875455669067264:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788574539.835360:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+10:18130:x1875455669067264:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 200us (9622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574539.837704:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 130 00000100:00100000:3.0:1788574539.857072:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574539.857129:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574539.857406:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669067392 00000100:00100000:0.0:1788574539.857423:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669067392 00000100:00100000:0.0:1788574539.857481:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669067648 00000100:00100000:0.0:1788574539.857485:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669067648 00000100:00100000:0.0:1788574539.857509:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1788574539.857518:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875455669067392:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788574539.857561:0:22627:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1d716dac-67f1-439f-bc22-0390f9279eab@192.168.204.51@tcp t0 exp 0000000000000000 cur 679 last 0 00000020:00000080:0.0:1788574539.857614:0:22627:0:(genops.c:1385:class_connect()) connect: client 1d716dac-67f1-439f-bc22-0390f9279eab, cookie 0x5bf8706fdac8de94 00000004:00100000:0.0:1788574539.857639:0:22627:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788574539.857882:0:22627:0:(import.c:65:import_set_state_nolock()) ffff9c85f7a5a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574539.857957:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d716dac-67f1-439f-bc22-0390f9279eab+6:2392:x1875455669067392:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 438us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574539.857965:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1788574539.857984:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:0.0:1788574539.857989:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875455669067648:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788574539.858006:0:22627:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 1d716dac-67f1-439f-bc22-0390f9279eab@192.168.204.51@tcp t0 exp 0000000000000000 cur 679 last 0 00000020:00000080:0.0:1788574539.858037:0:22627:0:(genops.c:1385:class_connect()) connect: client 1d716dac-67f1-439f-bc22-0390f9279eab, cookie 0x5bf8706fdac8de9b 00000004:00100000:0.0:1788574539.858051:0:22627:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788574539.858724:0:22627:0:(import.c:65:import_set_state_nolock()) ffff9c85f7a59800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574539.858780:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d716dac-67f1-439f-bc22-0390f9279eab+6:2392:x1875455669067648:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 789us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574539.858789:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:3.0:1788574539.876607:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574539.876646:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574539.876783:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574539.881974:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669067904 00000100:00100000:1.0:1788574539.881992:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669067904 00000100:00100000:1.0:1788574539.882167:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669067776 00000100:00100000:1.0:1788574539.882172:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669067776 00000100:00100000:1.0:1788574539.882213:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669067520 00000100:00100000:1.0:1788574539.882217:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669067520 00000100:00100000:1.0:1788574539.882239:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1788574539.882250:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+7:18107:x1875455669067904:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788574539.882300:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788574539.884031:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+7:18107:x1875455669067904:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 158us (5812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574539.884053:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1788574539.884121:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1788574539.884137:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+6:0:x1875455669067776:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788574539.884170:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788574539.884281:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+6:0:x1875455669067776:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 151us (7633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574539.884298:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1788574539.884314:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:1.0:1788574539.884321:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+6:0:x1875455669067520:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788574539.884334:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788574539.884377:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+6:0:x1875455669067520:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 57us (7594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574539.884384:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00080000:1.0:1788574539.884583:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574539.884588:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574539.891427:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574539.891700:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669068032 00000100:00100000:0.0:1788574539.891711:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669068032 00000100:00100000:0.0:1788574539.891776:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:0.0:1788574539.891787:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d716dac-67f1-439f-bc22-0390f9279eab+6:18107:x1875455669068032:12345-192.168.204.51@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788574539.891913:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d716dac-67f1-439f-bc22-0390f9279eab+6:18107:x1875455669068032:12345-192.168.204.51@tcp:40:mount.lustre.0 Request processed in 126us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574539.891922:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1788574539.895325:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574539.895375:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574539.895513:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669068416 00000100:00100000:3.0:1788574539.895534:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669068416 00000100:00100000:0.0:1788574539.895596:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669068544 00000100:00100000:0.0:1788574539.895602:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669068544 00000100:00100000:0.0:1788574539.895656:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:0.0:1788574539.895666:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1d716dac-67f1-439f-bc22-0390f9279eab+6:18107:x1875455669068544:12345-192.168.204.51@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788574539.895704:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 131 00000100:00100000:3.0:1788574539.895713:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+10:2396:x1875455669068416:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574539.895754:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1d716dac-67f1-439f-bc22-0390f9279eab+6:18107:x1875455669068544:12345-192.168.204.51@tcp:900:mount.lustre.0 Request processed in 88us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574539.895762:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:2.0:1788574539.897914:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574539.898612:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574539.898702:0:24616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669068160 00000100:00100000:2.0:1788574539.898712:0:24616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669068160 00000100:00100000:2.0:1788574539.898744:0:24616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669068288 00000100:00100000:2.0:1788574539.898747:0:24616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669068288 00000100:00100000:2.0:1788574539.898771:0:24616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:2.0:1788574539.898779:0:24616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875455669068160:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788574539.898815:0:24616:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1d716dac-67f1-439f-bc22-0390f9279eab@192.168.204.51@tcp t0 exp 0000000000000000 cur 679 last 0 00000020:00000080:2.0:1788574539.898848:0:24616:0:(genops.c:1385:class_connect()) connect: client 1d716dac-67f1-439f-bc22-0390f9279eab, cookie 0x5bf8706fdac8dea2 00002000:00100000:2.0:1788574539.898874:0:24616:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1d716dac-67f1-439f-bc22-0390f9279eab/ffff9c85f7a04800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788574539.898893:0:24616:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788574539.899097:0:24616:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788574539.899130:0:24616:0:(import.c:65:import_set_state_nolock()) ffff9c85f7a07000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574539.899221:0:24616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d716dac-67f1-439f-bc22-0390f9279eab+6:2392:x1875455669068160:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 440us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574539.899229:0:24616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:2.0:1788574539.899250:0:24616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:2.0:1788574539.899255:0:24616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875455669068288:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788574539.899274:0:24616:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1d716dac-67f1-439f-bc22-0390f9279eab@192.168.204.51@tcp t0 exp 0000000000000000 cur 679 last 0 00000020:00000080:2.0:1788574539.899291:0:24616:0:(genops.c:1385:class_connect()) connect: client 1d716dac-67f1-439f-bc22-0390f9279eab, cookie 0x5bf8706fdac8dea9 00002000:00100000:2.0:1788574539.899297:0:24616:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1d716dac-67f1-439f-bc22-0390f9279eab/ffff9c85f7a03000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788574539.899308:0:24616:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788574539.903838:0:24616:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788574539.903897:0:24616:0:(import.c:65:import_set_state_nolock()) ffff9c85f7a01000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574539.903981:0:24616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d716dac-67f1-439f-bc22-0390f9279eab+6:2392:x1875455669068288:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 4718us (5366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574539.903994:0:24616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1788574539.907868:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+10:2396:x1875455669068416:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 12142us (12478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574539.907888:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 131 00000001:00100000:1.0:1788574539.909097:0:24954:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1d716dac-67f1-439f-bc22-0390f9279eab 00000001:00080000:1.0:1788574539.909114:0:24954:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:2.0:1788574539.909438:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574539.909739:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669068672 00000100:00100000:3.0:1788574539.909750:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669068672 00000100:00100000:3.0:1788574539.909803:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1788574539.909814:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d716dac-67f1-439f-bc22-0390f9279eab+6:18107:x1875455669068672:12345-192.168.204.51@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788574539.913658:0:22630:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3746us 00000100:00100000:3.0:1788574539.924395:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681767296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574539.924484:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574539.926245:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681767296 00000100:00100000:0.0:1788574539.926259:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681767296 00000100:00100000:0.0:1788574539.926338:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788574539.926352:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681767296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788574539.926377:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788574539.926451:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681767296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574539.926459:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788574539.926534:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681767296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574539.927328:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574539.927342:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681767424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574539.927390:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788574539.928830:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574539.929180:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681767424 00000100:00100000:0.0:1788574539.929214:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681767424 00000100:00100000:0.0:1788574539.929330:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788574539.929340:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681767424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574539.929365:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788574539.929459:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681767424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (2068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574539.929467:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788574539.929542:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788574539.930016:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681767424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574539.930876:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681767936:0@lo:400:kworker.0 00000100:00100000:0.0:1788574539.930949:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574539.930980:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681768448:0@lo:400:kworker.0 00000100:00100000:0.0:1788574539.931003:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574539.931042:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788574539.931049:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a90d265-af03-4b80-95da-0de9cffed3f2:3619:1875455681767552:0@lo:400:kworker.0 00000100:00100000:0.0:1788574539.931091:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574539.931121:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681768064:0@lo:400:kworker.0 00000100:00100000:0.0:1788574539.931147:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574539.931165:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681768576:0@lo:400:kworker.0 00000100:00100000:0.0:1788574539.931218:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574539.931250:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681767936 00000100:00100000:0.0:1788574539.931256:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681767936 00000100:00100000:0.0:1788574539.931299:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681768448 00000100:00100000:0.0:1788574539.931303:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681768448 00000100:00100000:3.0:1788574539.931449:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681767552 00000100:00100000:3.0:1788574539.931454:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681767552 00000100:00100000:3.0:1788574539.931502:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788574539.931510:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+24:3619:x1875455681767552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574539.931577:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+24:3619:x1875455681767552:12345-0@lo:400:kworker.0 Request processed in 67us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574539.931584:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788574539.931627:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a90d265-af03-4b80-95da-0de9cffed3f2:3619:1875455681767552:0@lo:400:kworker.0 00000100:00080000:1.0:1788574539.938137:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574539.938151:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574539.938404:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681768576 00000100:00100000:1.0:1788574539.938417:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681768576 00000100:00100000:1.0:1788574539.938516:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788574539.938537:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681767936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574539.938666:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788574539.938694:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681768576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574539.938803:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681768576:12345-0@lo:400:kworker.0 Request processed in 111us (7584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574539.938811:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788574539.938835:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788574539.938881:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3727100 x1875455681768576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574539.938897:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681768576:0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.939059:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681767936:12345-0@lo:400:kworker.0 Request processed in 524us (8108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574539.939066:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788574539.939238:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3725180 x1875455681767936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574539.939249:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681767936:0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.939327:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681767680:0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.939373:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574539.939442:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681768192:0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.939480:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574539.939501:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681768704:0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.939537:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574539.939585:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788574539.939592:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681767808:0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.939616:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574539.939633:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681768320:0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.939654:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574539.939669:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681768832:0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.939689:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574539.939713:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681768192 00000100:00100000:1.0:1788574539.939719:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681768192 00000100:00100000:1.0:1788574539.939759:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681767808 00000100:00100000:1.0:1788574539.939763:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681767808 00000100:00100000:1.0:1788574539.939786:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788574539.939793:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681768192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.939833:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681768192:12345-0@lo:400:kworker.0 Request processed in 40us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574539.939839:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788574539.939852:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788574539.939858:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681767808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.939885:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681767808:12345-0@lo:400:kworker.0 Request processed in 28us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574539.939891:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788574539.939924:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681768704 00000100:00100000:1.0:1788574539.939927:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681768704 00000100:00100000:1.0:1788574539.939946:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681768320 00000100:00100000:1.0:1788574539.939949:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681768320 00000100:00100000:1.0:1788574539.939958:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681768832 00000100:00100000:1.0:1788574539.939960:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681768832 00000100:00100000:1.0:1788574539.939974:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788574539.939990:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681768704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.940037:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681768704:12345-0@lo:400:kworker.0 Request processed in 50us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574539.940043:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788574539.940056:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788574539.940062:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681768320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.942326:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681768320:12345-0@lo:400:kworker.0 Request processed in 2255us (2661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574539.942339:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788574539.942373:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788574539.942384:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681768832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.942421:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681768832:12345-0@lo:400:kworker.0 Request processed in 41us (2730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574539.942427:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788574539.942489:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681767808:0@lo:400:kworker.0 00010000:00080000:1.0:1788574539.942506:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3724000 x1875455681768320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574539.942516:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681768320:0@lo:400:kworker.0 00010000:00080000:1.0:1788574539.942538:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf5d500 x1875455681768832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574539.942546:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681768832:0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.943547:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681768192:0@lo:400:kworker.0 00010000:00080000:1.0:1788574539.943643:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3725500 x1875455681768704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574539.943672:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681768704:0@lo:400:kworker.0 00000100:00100000:3.0:1788574539.945788:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681768064 00000100:00100000:3.0:1788574539.945802:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681768064 00000100:00100000:3.0:1788574539.945856:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681767680 00000100:00100000:3.0:1788574539.945859:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681767680 00000100:00100000:3.0:1788574539.945878:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788574539.945887:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681768064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574539.945996:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681768064:12345-0@lo:400:kworker.0 Request processed in 110us (14847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574539.948416:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788574539.948443:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681767680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574539.949698:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788574539.950240:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681767680:12345-0@lo:400:kworker.0 Request processed in 1806us (10862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574539.950253:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788574539.950298:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788574539.950303:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574539.950307:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574539.950370:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681768064:0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.951487:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681767680:0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.951982:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788574539.951995:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681768448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574539.952272:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681768448:12345-0@lo:400:kworker.0 Request processed in 281us (21268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574539.952279:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788574539.952320:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3726d80 x1875455681768448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574539.952335:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681768448:0@lo:400:kworker.0 00000004:00200000:0.0:1788574539.967814:0:22630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788574539.967985:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d716dac-67f1-439f-bc22-0390f9279eab+6:18107:x1875455669068672:12345-192.168.204.51@tcp:33:mount.lustre.0 Request processed in 58164us (58541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574539.968012:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:0.0:1788574540.304257:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574540.304360:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669068800 00000100:00100000:2.0:1788574540.304382:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669068800 00000100:00100000:2.0:1788574540.304439:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1788574540.304450:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d716dac-67f1-439f-bc22-0390f9279eab+6:18153:x1875455669068800:12345-192.168.204.51@tcp:101:mkdir.0 00010000:00010000:2.0:1788574540.304481:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574540.304509:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8deb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6d98 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574540.304593:0:23650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8deb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574540.304621:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8deb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574540.304636:0:23650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8deb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574540.304691:0:23650:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788574540.304695:0:23650:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788574540.304735:0:23650:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8deb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574540.304763:0:23650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8deb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d98 expref: 8 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574540.304784:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8deb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d98 expref: 7 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574540.304809:0:23650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:2.0:1788574540.304813:0:23650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788574540.304817:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f400, rc 0) 00000100:00100000:2.0:1788574540.304889:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d716dac-67f1-439f-bc22-0390f9279eab+7:18153:x1875455669068800:12345-192.168.204.51@tcp:101:mkdir.0 Request processed in 440us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574540.304896:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00010000:00010000:0.0:1788574540.307361:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574541.332689:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574542.355457:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574542.484211:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574542.484238:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681768960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788574542.484311:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574542.484577:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681768960 00000100:00100000:0.0:1788574542.484585:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681768960 00000100:00100000:0.0:1788574542.484665:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788574542.484676:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681768960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788574542.484709:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788574542.484765:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681768960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574542.484773:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574542.484821:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681768960:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788574542.484844:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574542.610743:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574542.610844:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669068928 00000100:00100000:2.0:1788574542.610854:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669068928 00000100:00100000:2.0:1788574542.610935:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:2.0:1788574542.610955:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+7:18206:x1875455669068928:12345-192.168.204.51@tcp:41:lfs.0 00000004:00000024:2.0:1788574542.610999:0:22629:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788574542.611097:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+7:18206:x1875455669068928:12345-192.168.204.51@tcp:41:lfs.0 Request processed in 145us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574542.611104:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00080000:3.0:1788574542.611761:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574542.616372:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574542.616457:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669069056 00000100:00100000:3.0:1788574542.616466:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669069056 00000100:00100000:3.0:1788574542.616554:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1788574542.616578:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d716dac-67f1-439f-bc22-0390f9279eab+6:18206:x1875455669069056:12345-192.168.204.51@tcp:41:lfs.0 00000004:00000024:3.0:1788574542.616615:0:24885:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788574542.616702:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d716dac-67f1-439f-bc22-0390f9279eab+6:18206:x1875455669069056:12345-192.168.204.51@tcp:41:lfs.0 Request processed in 127us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574542.616709:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00080000:2.0:1788574542.617290:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788574542.622532:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574542.622745:0:24140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669069184 00000100:00100000:3.0:1788574542.622760:0:24140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669069184 00000100:00100000:3.0:1788574542.622920:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1788574542.622936:0:24140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1d716dac-67f1-439f-bc22-0390f9279eab+6:18206:x1875455669069184:12345-192.168.204.51@tcp:13:lfs.0 00002000:00000024:3.0:1788574542.622986:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788574542.623377:0:24140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1d716dac-67f1-439f-bc22-0390f9279eab+6:18206:x1875455669069184:12345-192.168.204.51@tcp:13:lfs.0 Request processed in 443us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574542.623387:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1788574542.627237:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574542.627410:0:24140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669069312 00000100:00100000:3.0:1788574542.627425:0:24140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669069312 00000100:00080000:2.0:1788574542.627554:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574542.627560:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574542.627921:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:3.0:1788574542.627936:0:24140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1d716dac-67f1-439f-bc22-0390f9279eab+5:18206:x1875455669069312:12345-192.168.204.51@tcp:13:lfs.0 00002000:00000024:3.0:1788574542.627998:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788574542.628360:0:24140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1d716dac-67f1-439f-bc22-0390f9279eab+5:18206:x1875455669069312:12345-192.168.204.51@tcp:13:lfs.0 Request processed in 426us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574542.628369:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:1.0:1788574542.860821:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574542.860936:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669069440 00000100:00100000:3.0:1788574542.860951:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669069440 00000100:00100000:3.0:1788574542.861054:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00100000:3.0:1788574542.861068:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+10:18238:x1875455669069440:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788574542.861115:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574542.861147:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85f7ac9600/0x5bf8706fdac8debe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6d9f expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574542.861251:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85f7ac9600/0x5bf8706fdac8debe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d9f expref: 11 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574542.861265:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85f7ac9600/0x5bf8706fdac8debe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d9f expref: 11 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574542.861277:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85f7ac9600, rc 0) 00000100:00100000:3.0:1788574542.861359:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+11:18238:x1875455669069440:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 294us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574542.861367:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00100000:1.0:1788574542.868593:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574542.869791:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669069568 00000100:00100000:3.0:1788574542.869809:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669069568 00000100:00100000:3.0:1788574542.869906:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00100000:3.0:1788574542.869919:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+11:18238:x1875455669069568:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788574542.870441:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+11:18238:x1875455669069568:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 523us (1863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574542.870450:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00100000:1.0:1788574542.880462:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574542.880580:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669069696 00000100:00100000:2.0:1788574542.880596:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669069696 00000100:00100000:2.0:1788574542.880679:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 135 00000100:00100000:2.0:1788574542.880691:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+11:18238:x1875455669069696:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788574542.880925:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+11:18238:x1875455669069696:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 235us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574542.880935:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 135 00000100:00100000:1.0:1788574542.892733:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574542.893256:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669069824 00000100:00100000:3.0:1788574542.893272:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669069824 00000100:00100000:3.0:1788574542.893354:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 136 00000100:00100000:3.0:1788574542.893366:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+11:18245:x1875455669069824:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788574542.893600:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+11:18245:x1875455669069824:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 234us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574542.893616:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 136 00000100:00100000:0.0:1788574542.920724:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574542.920841:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669069952 00000100:00100000:1.0:1788574542.920855:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669069952 00000100:00100000:1.0:1788574542.920934:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:1.0:1788574542.920947:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+11:18245:x1875455669069952:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788574542.921293:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+11:18245:x1875455669069952:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 347us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574542.921315:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:1.0:1788574542.924238:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574542.924519:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669070080 00000100:00100000:2.0:1788574542.924534:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669070080 00000100:00100000:2.0:1788574542.924652:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 138 00000100:00100000:2.0:1788574542.924664:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+11:18245:x1875455669070080:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574542.924887:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+11:18245:x1875455669070080:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 224us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574542.924897:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 138 00000100:00100000:1.0:1788574542.927783:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574542.927930:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669070208 00000100:00100000:2.0:1788574542.927946:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669070208 00000100:00100000:2.0:1788574542.928046:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 139 00000100:00100000:2.0:1788574542.928061:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+11:18238:x1875455669070208:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788574542.928087:0:22619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574542.928111:0:22619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8dec5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6dd0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574542.928151:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8dec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6dd0 expref: 12 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574542.928165:0:22619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8dec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6dd0 expref: 12 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574542.928178:0:22619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f200, rc 0) 00000100:00100000:2.0:1788574542.928305:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+12:18238:x1875455669070208:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 247us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574542.928334:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 139 00000100:00100000:0.0:1788574542.946640:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574542.947249:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669070336 00000100:00100000:2.0:1788574542.947264:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669070336 00000100:00100000:2.0:1788574542.947347:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 140 00000100:00100000:2.0:1788574542.947361:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+12:18238:x1875455669070336:12345-192.168.204.51@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788574542.947397:0:22619:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788574542.947434:0:22619:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788574542.947440:0:22619:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788574542.947444:0:22619:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788574542.947448:0:22619:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788574542.947451:0:22619:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1788574542.949872:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+12:18238:x1875455669070336:12345-192.168.204.51@tcp:256:mount.lustre.0 Request processed in 2498us (3231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574542.949895:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 140 00000100:00100000:1.0:1788574542.954010:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574542.954707:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669070464 00000100:00100000:3.0:1788574542.954723:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669070464 00000100:00100000:3.0:1788574542.954811:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00100000:3.0:1788574542.954822:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+12:18238:x1875455669070464:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788574542.954847:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574542.954872:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85f7ac8e00/0x5bf8706fdac8decc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6dd7 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574542.954912:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85f7ac8e00/0x5bf8706fdac8decc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6dd7 expref: 13 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574542.954928:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85f7ac8e00/0x5bf8706fdac8decc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6dd7 expref: 13 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574542.954939:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85f7ac8e00, rc 0) 00000100:00100000:3.0:1788574542.955042:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:18238:x1875455669070464:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 215us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574542.955050:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00100000:0.0:1788574542.962798:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574542.962981:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669070592 00000100:00100000:3.0:1788574542.962996:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669070592 00000100:00100000:3.0:1788574542.963087:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 142 00000100:00100000:3.0:1788574542.963098:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:18238:x1875455669070592:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788574542.963409:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:18238:x1875455669070592:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 311us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574542.963419:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 142 00000100:00100000:1.0:1788574542.966125:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574542.966247:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669070720 00000100:00100000:0.0:1788574542.966261:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669070720 00000100:00100000:0.0:1788574542.966337:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 143 00000100:00100000:0.0:1788574542.966350:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:18238:x1875455669070720:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788574542.966603:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:18238:x1875455669070720:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 255us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574542.966612:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 143 00000100:00100000:2.0:1788574542.970499:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574542.970630:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669070848 00000100:00100000:1.0:1788574542.970644:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669070848 00000100:00100000:1.0:1788574542.970781:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 144 00000100:00100000:1.0:1788574542.970795:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:18248:x1875455669070848:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788574542.971068:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:18248:x1875455669070848:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 275us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574542.971077:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 144 00000100:00100000:1.0:1788574542.991429:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574542.991668:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669070976 00000100:00100000:3.0:1788574542.991682:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669070976 00000100:00100000:3.0:1788574542.991761:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 145 00000100:00100000:3.0:1788574542.991774:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85cca03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:18248:x1875455669070976:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788574542.992429:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85cca03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:18248:x1875455669070976:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 653us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574542.992442:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 145 00000100:00100000:1.0:1788574542.998490:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681769216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574542.998604:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574542.998837:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574542.998852:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681769088:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574542.998890:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574542.999044:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681769216 00000100:00100000:2.0:1788574542.999055:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681769216 00000100:00100000:2.0:1788574542.999127:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681769088 00000100:00100000:2.0:1788574542.999130:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681769088 00000100:00100000:2.0:1788574542.999150:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788574542.999160:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681769216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788574542.999228:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788574542.999291:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681769216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574542.999299:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788574542.999320:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788574542.999327:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681769088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788574542.999343:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788574542.999375:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681769088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574542.999402:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788574542.999570:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681769088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574542.999743:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681769216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574543.002905:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574543.003039:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574543.003315:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669071104 00000100:00100000:1.0:1788574543.003329:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669071104 00000100:00100000:1.0:1788574543.003386:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669071360 00000100:00100000:1.0:1788574543.003391:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669071360 00000100:00100000:1.0:1788574543.003422:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:1.0:1788574543.003431:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1875455669071104:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788574543.003488:0:22628:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from da9b2dd6-a8f1-4669-acb6-2a6fb947733d@192.168.204.51@tcp t0 exp 0000000000000000 cur 682 last 0 00000020:00000080:1.0:1788574543.003547:0:22628:0:(genops.c:1385:class_connect()) connect: client da9b2dd6-a8f1-4669-acb6-2a6fb947733d, cookie 0x5bf8706fdac8ded3 00000004:00100000:1.0:1788574543.003597:0:22628:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788574543.003766:0:22628:0:(import.c:65:import_set_state_nolock()) ffff9c84c34d6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574543.003869:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:2392:x1875455669071104:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 436us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574543.003878:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:1.0:1788574543.003903:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:1.0:1788574543.003909:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1875455669071360:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788574543.003928:0:22628:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from da9b2dd6-a8f1-4669-acb6-2a6fb947733d@192.168.204.51@tcp t0 exp 0000000000000000 cur 682 last 0 00000020:00000080:1.0:1788574543.003982:0:22628:0:(genops.c:1385:class_connect()) connect: client da9b2dd6-a8f1-4669-acb6-2a6fb947733d, cookie 0x5bf8706fdac8deda 00000004:00100000:1.0:1788574543.004000:0:22628:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788574543.004069:0:22628:0:(import.c:65:import_set_state_nolock()) ffff9c85d20eb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574543.004099:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:2392:x1875455669071360:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 188us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574543.004106:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:1.0:1788574543.005158:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574543.005265:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574543.005299:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574543.005345:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669072000 00000100:00100000:3.0:1788574543.005354:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669072000 00000100:00100000:3.0:1788574543.005415:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:3.0:1788574543.005425:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d716dac-67f1-439f-bc22-0390f9279eab+6:2395:x1875455669072000:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574543.005503:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d716dac-67f1-439f-bc22-0390f9279eab+6:2395:x1875455669072000:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 80us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574543.005511:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:1.0:1788574543.010328:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574543.010364:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574543.010388:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574543.010415:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574543.010450:0:24616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669072128 00000100:00100000:1.0:1788574543.010474:0:24616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669072128 00000100:00100000:1.0:1788574543.010555:0:24616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1788574543.010568:0:24616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d716dac-67f1-439f-bc22-0390f9279eab+5:2395:x1875455669072128:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574543.011073:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669071744 00000100:00100000:3.0:1788574543.011081:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669071744 00000100:00100000:3.0:1788574543.011114:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669071872 00000100:00100000:3.0:1788574543.011118:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669071872 00000100:00100000:3.0:1788574543.011132:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669071488 00000100:00100000:3.0:1788574543.011134:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669071488 00000100:00100000:3.0:1788574543.011165:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669071232 00000100:00100000:3.0:1788574543.011169:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669071232 00000100:00100000:3.0:1788574543.011183:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669071616 00000100:00100000:3.0:1788574543.011186:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669071616 00000100:00100000:3.0:1788574543.011246:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:3.0:1788574543.011253:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+7:2395:x1875455669071744:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574543.011352:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+7:2395:x1875455669071744:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 99us (6201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574543.011360:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:3.0:1788574543.011379:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:3.0:1788574543.011385:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+6:2395:x1875455669071872:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574543.011412:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+6:2395:x1875455669071872:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (6113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574543.011418:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:3.0:1788574543.011430:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:3.0:1788574543.011436:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:0:x1875455669071488:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788574543.011459:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788574543.011513:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:0:x1875455669071488:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 77us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574543.011519:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:3.0:1788574543.011532:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:3.0:1788574543.011538:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+7:0:x1875455669071232:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788574543.011551:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788574543.011906:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+7:0:x1875455669071232:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 366us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574543.011914:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:3.0:1788574543.011930:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:3.0:1788574543.011937:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:18238:x1875455669071616:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788574543.012105:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788574543.012136:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:18238:x1875455669071616:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 200us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574543.012142:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00080000:3.0:1788574543.012168:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574543.012174:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788574543.013408:0:24616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d716dac-67f1-439f-bc22-0390f9279eab+5:2395:x1875455669072128:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 2835us (3088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574543.013435:0:24616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:3.0:1788574543.016345:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574543.016494:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669072256 00000100:00100000:1.0:1788574543.016506:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669072256 00000100:00100000:1.0:1788574543.016595:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:1.0:1788574543.016608:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:18238:x1875455669072256:12345-192.168.204.51@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788574543.016727:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:18238:x1875455669072256:12345-192.168.204.51@tcp:40:mount.lustre.0 Request processed in 121us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574543.016735:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:1.0:1788574543.019335:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574543.019440:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574543.019487:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574543.019592:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669072384 00000100:00100000:2.0:1788574543.019606:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669072384 00000100:00100000:2.0:1788574543.019656:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669072512 00000100:00100000:2.0:1788574543.019660:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669072512 00000100:00100000:2.0:1788574543.019681:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:2.0:1788574543.019691:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1875455669072384:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788574543.019736:0:24137:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from da9b2dd6-a8f1-4669-acb6-2a6fb947733d@192.168.204.51@tcp t0 exp 0000000000000000 cur 682 last 0 00000020:00000080:2.0:1788574543.019785:0:24137:0:(genops.c:1385:class_connect()) connect: client da9b2dd6-a8f1-4669-acb6-2a6fb947733d, cookie 0x5bf8706fdac8dee1 00002000:00100000:2.0:1788574543.019802:0:24137:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli da9b2dd6-a8f1-4669-acb6-2a6fb947733d/ffff9c85f7a06800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788574543.019817:0:24137:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788574543.019906:0:24137:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788574543.019961:0:24137:0:(import.c:65:import_set_state_nolock()) ffff9c85f7a02800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574543.020062:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:2392:x1875455669072384:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 371us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574543.020071:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:2.0:1788574543.020095:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:2.0:1788574543.020100:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1875455669072512:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788574543.020119:0:24137:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from da9b2dd6-a8f1-4669-acb6-2a6fb947733d@192.168.204.51@tcp t0 exp 0000000000000000 cur 682 last 0 00000020:00000080:2.0:1788574543.020138:0:24137:0:(genops.c:1385:class_connect()) connect: client da9b2dd6-a8f1-4669-acb6-2a6fb947733d, cookie 0x5bf8706fdac8dee8 00002000:00100000:2.0:1788574543.020145:0:24137:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli da9b2dd6-a8f1-4669-acb6-2a6fb947733d/ffff9c85f7a07800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788574543.020152:0:24137:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788574543.020260:0:24137:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788574543.020277:0:24137:0:(import.c:65:import_set_state_nolock()) ffff9c85f7a01800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574543.020303:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:2392:x1875455669072512:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 201us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574543.020309:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:0.0:1788574543.022646:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669072640 00000100:00100000:0.0:1788574543.022668:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669072640 00000100:00100000:0.0:1788574543.022814:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1788574543.022827:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:18238:x1875455669072640:12345-192.168.204.51@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788574543.022973:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:18238:x1875455669072640:12345-192.168.204.51@tcp:900:mount.lustre.0 Request processed in 149us (3652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574543.022982:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:1.0:1788574543.026961:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574543.027100:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669072768 00000100:00100000:2.0:1788574543.027115:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669072768 00000100:00100000:2.0:1788574543.027221:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:2.0:1788574543.027233:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:18238:x1875455669072768:12345-192.168.204.51@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788574543.027365:0:22631:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788574543.027530:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:18238:x1875455669072768:12345-192.168.204.51@tcp:33:mount.lustre.0 Request processed in 298us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574543.027538:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:2.0:1788574543.194833:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574543.195634:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669072896 00000100:00100000:0.0:1788574543.195651:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669072896 00000100:00100000:0.0:1788574543.195750:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:0.0:1788574543.195761:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:18271:x1875455669072896:12345-192.168.204.51@tcp:101:mkdir.0 00010000:00010000:0.0:1788574543.195789:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574543.195830:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8deef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e08 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.195955:0:23650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8def6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.195977:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8def6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.196000:0:23650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8def6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574543.196096:0:23650:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788574543.196101:0:23650:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574543.196134:0:23650:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8def6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.196173:0:23650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8deef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e08 expref: 8 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.196249:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8def6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e08 expref: 7 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.196285:0:23650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:0.0:1788574543.196288:0:23650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574543.196293:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7000, rc 0) 00000100:00100000:0.0:1788574543.196401:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+7:18271:x1875455669072896:12345-192.168.204.51@tcp:101:mkdir.0 Request processed in 640us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574543.196410:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00010000:00010000:0.0:1788574543.382508:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574543.508539:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574543.508578:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681769344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574543.508691:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574543.508836:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681769344 00000100:00100000:0.0:1788574543.508848:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681769344 00000100:00100000:0.0:1788574543.508945:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574543.508957:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681769344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574543.508988:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788574543.509049:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681769344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574543.509057:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574543.509116:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681769344:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788574543.509253:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788574544.403685:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574545.043533:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681769472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574545.043602:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574545.043735:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681769472 00000100:00100000:1.0:1788574545.043750:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681769472 00000100:00100000:1.0:1788574545.043823:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574545.043835:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681769472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574545.043864:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00080000:0.0:1788574545.044769:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574545.044805:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681769856:0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.045078:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574545.045127:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574545.045134:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a90d265-af03-4b80-95da-0de9cffed3f2:3618:1875455681769728:0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.045163:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574545.045239:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681769728 00000100:00100000:0.0:1788574545.045245:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681769728 00000100:00100000:0.0:1788574545.045282:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788574545.045315:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85cca03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+24:3618:x1875455681769728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.045357:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85cca03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+24:3618:x1875455681769728:12345-0@lo:400:kworker.0 Request processed in 44us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574545.045365:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788574545.045433:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a90d265-af03-4b80-95da-0de9cffed3f2:3618:1875455681769728:0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.045473:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681769600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574545.045497:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574545.045513:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681769984:0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.045531:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574545.045606:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681770112:0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.046877:0:24140:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788574545.046892:0:24140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788574545.047063:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681769984 00000100:00100000:0.0:1788574545.047072:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681769984 00000100:00100000:2.0:1788574545.047077:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574545.047162:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681769472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3328us (3556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574545.047174:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574545.047221:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681769600 00000100:00100000:1.0:1788574545.047226:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681769600 00000100:00100000:0.0:1788574545.047254:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574545.047259:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574545.047286:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681769600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574545.047307:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788574545.047349:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681769600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574545.047362:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574545.047395:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681769856 00000100:00100000:1.0:1788574545.047400:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681769856 00000100:00100000:1.0:1788574545.047439:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788574545.047447:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681769856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574545.047494:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681769856:12345-0@lo:400:kworker.0 Request processed in 47us (2414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574545.047502:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788574545.047529:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681770496:0@lo:400:kworker.0 00000100:00100000:1.0:1788574545.047565:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574545.047589:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681770112 00000100:00100000:3.0:1788574545.047595:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681770112 00000100:00100000:1.0:1788574545.047612:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681769600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574545.047635:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681771008:0@lo:400:kworker.0 00000100:00100000:1.0:1788574545.047659:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574545.047728:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681769984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.047765:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681769984:12345-0@lo:400:kworker.0 Request processed in 503us (2232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574545.047772:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788574545.047791:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574545.047794:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574545.047803:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681770240:0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.047842:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574545.047860:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681770752:0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.047897:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681770368:0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.047917:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574545.047941:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875455681770880:0@lo:400:kworker.0 00000100:00100000:2.0:1788574545.048010:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681769472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574545.048027:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681770624:0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.048277:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681770240 00000100:00100000:0.0:1788574545.048282:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681770240 00000100:00100000:0.0:1788574545.048372:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788574545.048381:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681770240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.048438:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681770240:12345-0@lo:400:kworker.0 Request processed in 58us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574545.048444:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788574545.048608:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681770496 00000100:00100000:0.0:1788574545.048609:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681771008 00000100:00100000:3.0:1788574545.048614:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681770496 00000100:00100000:0.0:1788574545.048616:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681771008 00000100:00100000:2.0:1788574545.048647:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788574545.048649:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681769984:0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.048659:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788574545.048662:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681770112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.048672:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681771008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574545.048703:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574545.048713:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681770112:12345-0@lo:400:kworker.0 Request processed in 55us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574545.048721:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788574545.048723:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681770752 00000100:00100000:3.0:1788574545.048728:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681770752 00000100:00100000:2.0:1788574545.048758:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788574545.048765:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681770496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.048799:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681771008:12345-0@lo:400:kworker.0 Request processed in 130us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574545.048806:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788574545.048893:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788574545.048902:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681770752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.048937:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681770752:12345-0@lo:400:kworker.0 Request processed in 37us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574545.048943:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1788574545.048962:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788574545.049059:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3725500 x1875455681771008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574545.049060:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681770496:12345-0@lo:400:kworker.0 Request processed in 293us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574545.049074:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788574545.049085:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681771008:0@lo:400:kworker.0 00000100:00100000:1.0:1788574545.049090:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681770240:0@lo:400:kworker.0 00000100:00100000:2.0:1788574545.049097:0:24616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681770368 00000100:00100000:2.0:1788574545.049102:0:24616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681770368 00000100:00100000:0.0:1788574545.049118:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681770496:0@lo:400:kworker.0 00010000:00080000:1.0:1788574545.049122:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3725f80 x1875455681770752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574545.049129:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574545.049138:0:24616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574545.049143:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681770752:0@lo:400:kworker.0 00000100:00100000:2.0:1788574545.049150:0:24616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681770368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574545.049179:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681770112:0@lo:400:kworker.0 00000100:00100000:1.0:1788574545.049183:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681770624 00000100:00100000:2.0:1788574545.049208:0:24616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681770368:12345-0@lo:400:kworker.0 Request processed in 44us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574545.049216:0:24616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788574545.049236:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574545.049329:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574545.049333:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681770624 00000100:00100000:0.0:1788574545.049363:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681769856:0@lo:400:kworker.0 00000100:00100000:1.0:1788574545.049379:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681770880 00000100:00100000:1.0:1788574545.049384:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681770880 00000100:00100000:0.0:1788574545.049388:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681770368:0@lo:400:kworker.0 00000100:00080000:3.0:1788574545.049406:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574545.049419:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788574545.049443:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574545.049448:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681770624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574545.049497:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681770624:12345-0@lo:400:kworker.0 Request processed in 53us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574545.049504:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788574545.049519:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875455681770880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574545.049559:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681770624:0@lo:400:kworker.0 00000100:00100000:0.0:1788574545.049568:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875455681770880:12345-0@lo:400:kworker.0 Request processed in 111us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574545.049575:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574545.049677:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875455681770880:0@lo:400:kworker.0 00010000:00010000:0.0:1788574545.428870:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574545.761247:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1788574546.073116:0:24132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of da9b2dd6-a8f1-4669-acb6-2a6fb947733d 00000001:00100000:1.0:1788574546.073129:0:24132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1d716dac-67f1-439f-bc22-0390f9279eab 00000001:00100000:3.0:1788574546.074538:0:22607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of da9b2dd6-a8f1-4669-acb6-2a6fb947733d 00000001:00100000:3.0:1788574546.074552:0:22607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1d716dac-67f1-439f-bc22-0390f9279eab 00000001:00100000:0.0:1788574546.081780:0:23358:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of da9b2dd6-a8f1-4669-acb6-2a6fb947733d 00000001:00100000:0.0:1788574546.081795:0:23358:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1d716dac-67f1-439f-bc22-0390f9279eab 00000001:02000400:2.0:1788574546.261728:0:25510:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788574546.452514:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574547.476971:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574547.606168:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681771136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574547.606265:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574547.606327:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681771136 00000100:00100000:1.0:1788574547.606335:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681771136 00000100:00100000:1.0:1788574547.606407:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788574547.606419:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681771136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574547.606450:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788574547.606498:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681771136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574547.606505:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788574547.606527:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574547.606567:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681771136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574548.040975:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574548.041024:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574548.041048:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669073152 00000100:00100000:3.0:1788574548.041055:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574548.041065:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669073152 00000100:00100000:3.0:1788574548.041103:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574548.041135:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574548.041143:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669073664 00000100:00100000:0.0:1788574548.041148:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669073664 00000100:00100000:3.0:1788574548.041166:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574548.041308:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669073408 00000100:00100000:1.0:1788574548.041313:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669073408 00000100:00100000:1.0:1788574548.041346:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669073920 00000100:00100000:1.0:1788574548.041349:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669073920 00000100:00100000:1.0:1788574548.041384:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1788574548.041394:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d716dac-67f1-439f-bc22-0390f9279eab+5:2396:x1875455669073408:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574548.041478:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d716dac-67f1-439f-bc22-0390f9279eab+5:2396:x1875455669073408:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 85us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.041486:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1788574548.041505:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:1.0:1788574548.041511:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+5:2396:x1875455669073920:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574548.041543:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+5:2396:x1875455669073920:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 33us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.041549:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:3.0:1788574548.043092:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574548.043121:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574548.043215:0:24616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669073536 00000100:00100000:2.0:1788574548.043223:0:24616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669073536 00000100:00100000:0.0:1788574548.043224:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669073280 00000100:00100000:0.0:1788574548.043231:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669073280 00000100:00100000:2.0:1788574548.043267:0:24616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:2.0:1788574548.043288:0:24616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d716dac-67f1-439f-bc22-0390f9279eab+5:2396:x1875455669073536:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574548.043350:0:24616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d716dac-67f1-439f-bc22-0390f9279eab+5:2396:x1875455669073536:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 68us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574548.043357:0:24616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:2.0:1788574548.044737:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669073024 00000100:00100000:2.0:1788574548.044750:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669073024 00000100:00100000:2.0:1788574548.044806:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 147 00000100:00100000:2.0:1788574548.044815:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:2396:x1875455669073024:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574548.044871:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:2396:x1875455669073024:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 58us (3735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574548.044891:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 147 00000100:00100000:2.0:1788574548.046315:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:2.0:1788574548.046339:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+6:2396:x1875455669073152:12345-192.168.204.51@tcp:400:kworker.0 00000100:00080000:0.0:1788574548.046391:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788574548.046400:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574548.046403:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574548.046406:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574548.046420:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+6:2396:x1875455669073152:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 92us (5455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574548.046429:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:0.0:1788574548.046446:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:0.0:1788574548.046458:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:2396:x1875455669073664:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574548.046464:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:2.0:1788574548.046475:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+5:2396:x1875455669073280:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574548.046501:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:2396:x1875455669073664:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 45us (5447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574548.046510:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:2.0:1788574548.046514:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+5:2396:x1875455669073280:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 40us (5347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574548.046809:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574548.046909:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669074048 00000100:00100000:3.0:1788574548.046916:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669074048 00000100:00100000:3.0:1788574548.046958:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1788574548.046966:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:2396:x1875455669074048:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574548.047009:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:2396:x1875455669074048:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 39us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574548.047015:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:1.0:1788574548.047115:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669073792 00000100:00100000:1.0:1788574548.047122:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669073792 00000100:00080000:0.0:1788574548.047182:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788574548.047207:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574548.050840:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:1.0:1788574548.053232:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:1.0:1788574548.053257:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+5:2396:x1875455669073792:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574548.053383:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+5:2396:x1875455669073792:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 138us (10260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.053392:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:2.0:1788574548.118407:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574548.118441:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681771392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574548.118537:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574548.118581:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681771264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574548.118605:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574548.118676:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681771392 00000100:00100000:3.0:1788574548.118689:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681771392 00000100:00100000:3.0:1788574548.118769:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681771264 00000100:00100000:3.0:1788574548.118774:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681771264 00000100:00100000:3.0:1788574548.118805:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788574548.118830:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681771392:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574548.118830:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788574548.118855:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681771264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788574548.118907:0:23367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000004:00000024:2.0:1788574548.118908:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788574548.124681:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681771264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5825us (6064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574548.124700:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788574548.124778:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681771264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574548.126830:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681771392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8000us (8279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574548.126986:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788574548.130113:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681771392:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788574548.499495:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574548.630606:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681771520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574548.630683:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574548.630916:0:25473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681771520 00000100:00100000:1.0:1788574548.630925:0:25473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681771520 00000100:00100000:1.0:1788574548.631000:0:25473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788574548.631012:0:25473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681771520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574548.631035:0:25473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788574548.631085:0:25473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681771520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.631092:0:25473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788574548.631137:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681771520:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788574548.631277:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788574548.883823:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1788574549.141402:0:24954:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of da9b2dd6-a8f1-4669-acb6-2a6fb947733d 00010000:00010000:2.0:1788574549.523412:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788574549.788291:0:25658:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcabfde600 20000000:00000080:2.0:1788574549.788310:0:25658:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c85f7a2c400 uarg=0000000000000000 20000000:01000000:2.0:1788574549.788366:0:25658:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788574549.788373:0:25658:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788574549.788378:0:25658:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788574549.788830:0:25659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788574549.788932:0:25658:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788574549.800789:0:25658:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788574549.800940:0:25658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8defd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574549.800963:0:25658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8db5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8db53 expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574549.800970:0:25658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8db68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8db61 expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574549.800977:0:25658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85faea2a00/0x5bf8706fdac8dba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8dba0 expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574549.800984:0:25658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8dd28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8dd21 expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574549.800993:0:25658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c84c2617c00/0x5bf8706fdac8de8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d67 expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574549.801087:0:25658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85f7ac8e00/0x5bf8706fdac8decc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6dd7 expref: 12 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574549.801094:0:25658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8defd lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574549.801137:0:25658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85f7ac8e00/0x5bf8706fdac8decc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6dd7 expref: 12 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574549.801153:0:25658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85f7ac8e00/0x5bf8706fdac8decc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6dd7 expref: 12 pid: 22622 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574549.801325:0:25658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6664000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25658:1875455681771648:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574549.801614:0:25658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c84c2617c00/0x5bf8706fdac8de8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d67 expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574549.801623:0:25658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c84c2617c00/0x5bf8706fdac8de8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d67 expref: 12 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574549.801632:0:25658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25658:1875455681771776:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574549.801664:0:25658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8dd28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8dd21 expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574549.801671:0:25658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8dd28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8dd21 expref: 23 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574549.801680:0:25658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25658:1875455681771904:0@lo:104: 00000100:00100000:1.0:1788574549.801718:0:25658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574549.801765:0:25658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85faea2a00/0x5bf8706fdac8dba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8dba0 expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574549.801773:0:25658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85faea2a00/0x5bf8706fdac8dba7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8dba0 expref: 23 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574549.801781:0:25658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25658:1875455681772032:0@lo:104: 00000100:00100000:1.0:1788574549.801803:0:25658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574549.801844:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681771904 00000100:00100000:1.0:1788574549.801851:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681771904 00000100:00100000:1.0:1788574549.801889:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681772032 00000100:00100000:1.0:1788574549.801893:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681772032 00000100:00100000:1.0:1788574549.801908:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788574549.801923:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+4:25658:x1875455681771904:12345-0@lo:104: 00010000:00010000:1.0:1788574549.801944:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8dd21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8dd28 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574549.801991:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788574549.802148:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+4:25658:x1875455681771904:12345-0@lo:104: Request processed in 227us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574549.802157:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788574549.802175:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574549.802182:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+3:25658:x1875455681772032:12345-0@lo:104: 00010000:00010000:1.0:1788574549.802222:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3400/0x5bf8706fdac8dba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8dba7 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574549.802260:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788574549.802265:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+3:25658:x1875455681772032:12345-0@lo:104: Request processed in 85us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574549.802272:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788574549.802314:0:25658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8db68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8db61 expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574549.802323:0:25658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8db68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8db61 expref: 23 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574549.802344:0:25658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25658:1875455681772160:0@lo:104: 00000100:00100000:1.0:1788574549.802369:0:25658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574549.802388:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681772160 00000100:00100000:1.0:1788574549.802392:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681772160 00000100:00100000:1.0:1788574549.802409:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574549.802414:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+3:25658:x1875455681772160:12345-0@lo:104: 00010000:00010000:1.0:1788574549.802432:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2c00/0x5bf8706fdac8db61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8db68 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574549.802465:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788574549.802470:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+3:25658:x1875455681772160:12345-0@lo:104: Request processed in 56us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574549.802477:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788574549.802504:0:25658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8db5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8db53 expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574549.802512:0:25658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8db5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8db53 expref: 23 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574549.802520:0:25658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10de300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25658:1875455681772288:0@lo:104: 00000100:00100000:1.0:1788574549.802541:0:25658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574549.802560:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681772288 00000100:00100000:1.0:1788574549.802564:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681772288 00000100:00100000:1.0:1788574549.802581:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788574549.802587:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+3:25658:x1875455681772288:12345-0@lo:104: 00010000:00010000:1.0:1788574549.802595:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8db53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8db5a expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574549.802621:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788574549.802626:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+3:25658:x1875455681772288:12345-0@lo:104: Request processed in 40us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574549.802632:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788574549.802654:0:25658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e0a25b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574549.802675:0:25658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25658:1875455681771904:0@lo:104: 00000100:00100000:1.0:1788574549.802694:0:25658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25658:1875455681772032:0@lo:104: 00000100:00100000:1.0:1788574549.802701:0:25658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25658:1875455681772160:0@lo:104: 00000100:00100000:1.0:1788574549.802707:0:25658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10de300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25658:1875455681772288:0@lo:104: 00010000:00010000:2.0:1788574549.803201:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788574549.803210:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8dd21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8dd28 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803218:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7600 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574549.803222:0:22615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8dd21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8dd28 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803231:0:22615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8dd21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8dd28 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574549.803239:0:22615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8dd21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8dd28 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574549.803244:0:22615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574549.803276:0:22615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8dd21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8dd28 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803284:0:22615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574549.803303:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8dd21 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8dd28 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803310:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8dd21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8dd28 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803353:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788574549.803357:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3400/0x5bf8706fdac8dba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8dba7 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803362:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a3400 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574549.803365:0:22615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3400/0x5bf8706fdac8dba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8dba7 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803371:0:22615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3400/0x5bf8706fdac8dba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8dba7 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574549.803377:0:22615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3400/0x5bf8706fdac8dba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8dba7 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574549.803382:0:22615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574549.803397:0:22615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3400/0x5bf8706fdac8dba0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8dba7 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803402:0:22615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574549.803419:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3400/0x5bf8706fdac8dba0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8dba7 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803427:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3400/0x5bf8706fdac8dba0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8dba7 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803435:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574549.803438:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2c00/0x5bf8706fdac8db61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8db68 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803454:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2c00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574549.803457:0:22615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2c00/0x5bf8706fdac8db61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8db68 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803464:0:22615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2c00/0x5bf8706fdac8db61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8db68 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574549.803471:0:22615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2c00/0x5bf8706fdac8db61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8db68 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574549.803476:0:22615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574549.803491:0:22615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2c00/0x5bf8706fdac8db61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8db68 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803496:0:22615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574549.803502:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2c00/0x5bf8706fdac8db61 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8db68 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803508:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2c00/0x5bf8706fdac8db61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8db68 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803518:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574549.803520:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8db53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8db5a expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803525:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2a00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574549.803528:0:22615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8db53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8db5a expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803544:0:22615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8db53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8db5a expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574549.803551:0:22615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8db53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8db5a expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574549.803556:0:22615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574549.803570:0:22615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8db53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8db5a expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803575:0:22615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574549.803581:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8db53 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8db5a expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803587:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8db53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8db5a expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803598:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574549.803600:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574549.803601:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574549.803614:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681772416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574549.803656:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574549.803695:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574549.803701:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681772800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574549.803722:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574549.803748:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a90d265-af03-4b80-95da-0de9cffed3f2:3618:1875455681772672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574549.803770:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574549.803786:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574549.803797:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a90d265-af03-4b80-95da-0de9cffed3f2:3618:1875455681772544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574549.803820:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574549.803852:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681772416 00000100:00100000:2.0:1788574549.803857:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681772416 00010000:00010000:2.0:1788574549.803879:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8dd28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8dd21 expref: 24 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574549.803894:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681772800 00000100:00100000:2.0:1788574549.803897:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681772800 00010000:00010000:2.0:1788574549.803906:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8db5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8db53 expref: 25 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574549.803915:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681772672 00000100:00100000:2.0:1788574549.803917:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681772672 00010000:00010000:0.0:1788574549.803923:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574549.803926:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8db68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8db61 expref: 26 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574549.803935:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681772544 00000100:00100000:2.0:1788574549.803937:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681772544 00010000:00010000:2.0:1788574549.803946:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85faea2a00/0x5bf8706fdac8dba7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8dba0 expref: 27 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574549.803958:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788574549.803964:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+27:3620:x1875455681772416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574549.803974:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574549.803979:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8dd28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8dd21 expref: 27 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.803987:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8dd28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8dd21 expref: 27 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.804250:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8dd28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8dd21 expref: 27 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.804264:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574549.804297:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+26:3620:x1875455681772416:12345-0@lo:103:ldlm_bl.0 Request processed in 332us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574549.804304:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788574549.804320:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574549.804327:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+25:3620:x1875455681772800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574549.804347:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574549.804351:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8db5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8db53 expref: 25 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.804360:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8db5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8db53 expref: 25 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.804368:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8db5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8db53 expref: 25 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.804376:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574549.804398:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+24:3620:x1875455681772800:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574549.804404:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574549.804416:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788574549.804422:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+23:3618:x1875455681772672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574549.804429:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574549.804433:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8db68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8db61 expref: 23 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.804447:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8db68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8db61 expref: 23 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.804457:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8db68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8db61 expref: 23 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.804466:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574549.804504:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+22:3618:x1875455681772672:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574549.804511:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788574549.804524:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788574549.804529:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:3618:x1875455681772544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574549.804537:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574549.804542:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85faea2a00/0x5bf8706fdac8dba7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8dba0 expref: 21 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.804550:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85faea2a00/0x5bf8706fdac8dba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8dba0 expref: 21 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.804560:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea2a00/0x5bf8706fdac8dba7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8dba0 expref: 21 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574549.804567:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574549.804588:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a90d265-af03-4b80-95da-0de9cffed3f2+20:3618:x1875455681772544:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574549.804594:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788574549.804634:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a90d265-af03-4b80-95da-0de9cffed3f2:3618:1875455681772544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574549.804643:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a90d265-af03-4b80-95da-0de9cffed3f2:3618:1875455681772672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574549.804991:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681772800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574549.805000:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681772416:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574549.806370:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574549.807405:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574549.807449:0:25658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6664000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25658:1875455681771648:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574549.808124:0:25658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25658:1875455681771776:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574549.808172:0:25658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8defd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574549.808401:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669074176 00000100:00100000:0.0:1788574549.808409:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669074176 00010000:00010000:0.0:1788574549.808441:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85f7ac8e00/0x5bf8706fdac8decc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6dd7 expref: 13 pid: 22622 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574549.808472:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1788574549.808480:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3267c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:2394:x1875455669074176:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574549.808686:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574549.808693:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85f7ac8e00/0x5bf8706fdac8decc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6dd7 expref: 13 pid: 22622 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574549.808718:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85f7ac8e00/0x5bf8706fdac8decc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6dd7 expref: 13 pid: 22622 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574549.808737:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85f7ac8e00/0x5bf8706fdac8decc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6dd7 expref: 13 pid: 22622 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574549.808752:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574549.808844:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3267c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+12:2394:x1875455669074176:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 364us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574549.808853:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1788574549.809725:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574549.810112:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669074304 00000100:00100000:3.0:1788574549.810119:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669074304 00010000:00010000:3.0:1788574549.810150:0:22614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c84c2617c00/0x5bf8706fdac8de8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d67 expref: 12 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574549.811662:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1788574549.811677:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+12:2394:x1875455669074304:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574549.811704:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574549.811712:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c84c2617c00/0x5bf8706fdac8de8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d67 expref: 12 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574549.811723:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c84c2617c00/0x5bf8706fdac8de8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d67 expref: 12 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574549.811741:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c84c2617c00/0x5bf8706fdac8de8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d67 expref: 12 pid: 22621 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574549.811755:0:22614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8defd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574549.811763:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8defd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574549.811780:0:22614:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8defd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574549.811786:0:22614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8defd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574549.811809:0:22614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8defd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574549.811816:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8defd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574549.811822:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6a00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574549.811826:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8defd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574549.811835:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8defd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574549.811857:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8defd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574549.811868:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574549.811932:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+11:2394:x1875455669074304:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 261us (2211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574549.811939:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00010000:00010000:0.0:1788574549.811991:0:25658:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8defd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574549.812000:0:25658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8defd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574549.812007:0:25658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8defd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574550.164503:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681773056:0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.164581:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574550.164615:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681773568:0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.164645:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574550.164662:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681774080:0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.164692:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574550.164717:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788574550.164724:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681773184:0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.164764:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574550.164782:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681773696:0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.164802:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574550.164816:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681774208:0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.164831:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574550.164857:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681773056 00000100:00100000:0.0:1788574550.164865:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681773056 00000100:00100000:0.0:1788574550.164903:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681773568 00000100:00100000:0.0:1788574550.164906:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681773568 00000100:00100000:0.0:1788574550.164922:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788574550.164930:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681773056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.164984:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681773056:12345-0@lo:400:kworker.0 Request processed in 54us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574550.164993:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788574550.165022:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788574550.165029:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681773568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.165065:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681773568:12345-0@lo:400:kworker.0 Request processed in 36us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574550.165072:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788574550.165085:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681773184 00000100:00100000:3.0:1788574550.165091:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681773184 00000100:00100000:0.0:1788574550.165095:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681774080 00000100:00100000:0.0:1788574550.165101:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681774080 00000100:00100000:0.0:1788574550.165136:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681774208 00000100:00100000:3.0:1788574550.165139:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681773696 00000100:00100000:0.0:1788574550.165140:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681774208 00000100:00100000:3.0:1788574550.165145:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681773696 00000100:00100000:0.0:1788574550.165167:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788574550.165177:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574550.165178:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681774080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574550.165214:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681773184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.165252:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681774080:12345-0@lo:400:kworker.0 Request processed in 78us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574550.165263:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681773184:12345-0@lo:400:kworker.0 Request processed in 77us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574550.165278:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574550.165291:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788574550.165305:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574550.165312:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788574550.165316:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681773696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.165335:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681774208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574550.165366:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681773696:12345-0@lo:400:kworker.0 Request processed in 53us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574550.165374:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574550.165382:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681774208:12345-0@lo:400:kworker.0 Request processed in 59us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574550.165390:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788574550.165482:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681772928:0@lo:400:kworker.0 00000100:00100000:2.0:1788574550.165515:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574550.165552:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681773440:0@lo:400:kworker.0 00000100:00100000:2.0:1788574550.165573:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788574550.165915:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788574550.165920:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574550.165923:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574550.165954:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681773184:0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.165966:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681773696:0@lo:400:kworker.0 00010000:00080000:0.0:1788574550.165978:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf5f800 x1875455681774208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574550.165988:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681774208:0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.166005:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681773056:0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.166018:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681773568:0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.166026:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681774080:0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.166108:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681774592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574550.166135:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574550.167704:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681773312:0@lo:400:kworker.0 00000100:00100000:3.0:1788574550.167851:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574550.167882:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681773824:0@lo:400:kworker.0 00000100:00100000:3.0:1788574550.167906:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574550.167924:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681774336:0@lo:400:kworker.0 00000100:00100000:3.0:1788574550.167985:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681773312 00000100:00100000:3.0:1788574550.167992:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681773312 00000100:00100000:3.0:1788574550.168041:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681773824 00000100:00100000:3.0:1788574550.168044:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681773824 00000100:00100000:3.0:1788574550.168061:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788574550.168068:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85eb691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681773312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574550.168124:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85eb691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681773312:12345-0@lo:400:kworker.0 Request processed in 55us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574550.168131:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788574550.168269:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681773952:0@lo:400:kworker.0 00000100:00100000:3.0:1788574550.168286:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788574550.168295:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681773824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574550.168302:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574550.168343:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681773824:12345-0@lo:400:kworker.0 Request processed in 49us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574550.168350:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574550.168433:0:24140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681774592 00000100:00100000:1.0:1788574550.168438:0:24140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681774592 00000100:00100000:1.0:1788574550.168470:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574550.168477:0:24140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681774592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574550.168503:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788574550.168543:0:24140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681774592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (2407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574550.168549:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574550.168598:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681774592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574550.173284:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681774464:0@lo:400:kworker.0 00000100:00100000:2.0:1788574550.173366:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574550.173401:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681773440 00000100:00100000:0.0:1788574550.173410:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681773440 00000100:00100000:0.0:1788574550.173467:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681773952 00000100:00100000:0.0:1788574550.173470:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681773952 00000100:00100000:0.0:1788574550.173506:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788574550.173514:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681773440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574550.173575:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788574550.173585:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681773952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574550.173639:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681773952:12345-0@lo:400:kworker.0 Request processed in 57us (5338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574550.173645:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788574550.173671:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574550.173757:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681774720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574550.177644:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681772928 00000100:00100000:3.0:1788574550.177659:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681772928 00000100:00100000:3.0:1788574550.177726:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788574550.177736:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+20:3620:x1875455681772928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.180876:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681773440:12345-0@lo:400:kworker.0 Request processed in 7350us (15289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574550.180893:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788574550.180931:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681774464 00000100:00100000:0.0:1788574550.180940:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681774464 00000100:00100000:0.0:1788574550.181212:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788574550.181221:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681774464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.181280:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681774464:12345-0@lo:400:kworker.0 Request processed in 61us (7914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574550.181287:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788574550.181359:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788574550.181391:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788574550.181720:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de93a300 x1875455681774464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574550.181735:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681774464:0@lo:400:kworker.0 00000100:00100000:2.0:1788574550.181834:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681773440:0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.181848:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681773312:0@lo:400:kworker.0 00000100:00100000:2.0:1788574550.181852:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681773952:0@lo:400:kworker.0 00000100:00100000:0.0:1788574550.181870:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681773824:0@lo:400:kworker.0 00000100:00100000:2.0:1788574550.181904:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681774336 00000100:00100000:2.0:1788574550.181910:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681774336 00000100:00100000:2.0:1788574550.181954:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788574550.181973:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681774336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574550.182024:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681774336:12345-0@lo:400:kworker.0 Request processed in 64us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574550.182031:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788574550.182251:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574550.182297:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681774720 00000100:00100000:1.0:1788574550.182302:0:24139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681774720 00000100:00100000:1.0:1788574550.182343:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788574550.182353:0:24139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681774720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574550.182371:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788574550.182421:0:24139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681774720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574550.182428:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788574550.182469:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681774720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574550.182470:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+20:3620:x1875455681772928:12345-0@lo:400:kworker.0 Request processed in 4732us (16949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574550.182483:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1788574550.182509:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574550.182537:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681774336:0@lo:400:kworker.0 00000100:00100000:3.0:1788574550.182554:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a90d265-af03-4b80-95da-0de9cffed3f2:3620:1875455681772928:0@lo:400:kworker.0 00010000:00010000:2.0:1788574550.548138:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574551.050822:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574551.050930:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669074432 00000100:00100000:2.0:1788574551.050942:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669074432 00000100:00100000:2.0:1788574551.051074:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 149 00000100:00100000:2.0:1788574551.051085:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+11:18121:x1875455669074432:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574551.051104:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574551.051126:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8df04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e0f expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.051155:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8df04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e0f expref: 12 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.051168:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8df04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e0f expref: 12 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.051178:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32fc00, rc 0) 00000100:00100000:2.0:1788574551.051640:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+12:18121:x1875455669074432:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 556us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574551.051648:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 149 00000100:00100000:2.0:1788574551.063481:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574551.063626:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669074560 00000100:00100000:3.0:1788574551.063637:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669074560 00000100:00100000:3.0:1788574551.063700:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 150 00000100:00100000:3.0:1788574551.063713:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+12:18121:x1875455669074560:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574551.064235:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+12:18121:x1875455669074560:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 522us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574551.064244:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 150 00000100:00100000:0.0:1788574551.066508:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574551.066709:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669074688 00000100:00100000:2.0:1788574551.066719:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669074688 00000100:00100000:2.0:1788574551.066780:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 151 00000100:00100000:2.0:1788574551.066790:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+12:18121:x1875455669074688:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574551.066954:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+12:18121:x1875455669074688:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 165us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574551.066963:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 151 00000100:00100000:0.0:1788574551.075686:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574551.075783:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669074816 00000100:00100000:3.0:1788574551.075794:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669074816 00000100:00100000:3.0:1788574551.075852:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 152 00000100:00100000:3.0:1788574551.075869:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+12:18121:x1875455669074816:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574551.075886:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574551.075906:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85f7ac8c00/0x5bf8706fdac8df0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e16 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.075949:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85f7ac8c00/0x5bf8706fdac8df0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e16 expref: 13 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.075970:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85f7ac8c00/0x5bf8706fdac8df0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e16 expref: 13 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.076005:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85f7ac8c00, rc 0) 00000100:00100000:3.0:1788574551.076362:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:18121:x1875455669074816:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 212us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574551.076371:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 152 00000100:00100000:0.0:1788574551.080760:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574551.080857:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669074944 00000100:00100000:2.0:1788574551.080869:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669074944 00000100:00100000:2.0:1788574551.081184:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 153 00000100:00100000:2.0:1788574551.081223:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:18121:x1875455669074944:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574551.081397:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:18121:x1875455669074944:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 177us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574551.081405:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 153 00000100:00100000:2.0:1788574551.087288:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574551.087421:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669075072 00000100:00100000:0.0:1788574551.087432:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669075072 00000100:00100000:0.0:1788574551.087487:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 154 00000100:00100000:0.0:1788574551.087497:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:18121:x1875455669075072:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574551.087642:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:18121:x1875455669075072:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 146us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574551.087659:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 154 00000100:00100000:0.0:1788574551.451999:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574551.452105:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669075200 00000100:00100000:3.0:1788574551.452117:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669075200 00000100:00080000:1.0:1788574551.452275:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574551.452375:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:3.0:1788574551.452387:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+6:18740:x1875455669075200:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574551.452408:0:22629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574551.452448:0:22629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9e00/0x5bf8706fdac8df12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e1d expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.452523:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8df19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.452539:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8df19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.452553:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8df19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.452568:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9400/0x5bf8706fdac8df20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.452574:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9400/0x5bf8706fdac8df20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.452581:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9400/0x5bf8706fdac8df20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.452674:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9000/0x5bf8706fdac8df27 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.452682:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9000/0x5bf8706fdac8df27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.452688:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9000/0x5bf8706fdac8df27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574551.452717:0:22629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788574551.452720:0:22629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788574551.453251:0:22629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9000/0x5bf8706fdac8df27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453265:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8df19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453272:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8df19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453277:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8df19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453283:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac8600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574551.453287:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8df19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453295:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8df19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453319:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:3.0:1788574551.453330:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574551.453337:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8df19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453344:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8df19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453360:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9400/0x5bf8706fdac8df20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453366:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9400/0x5bf8706fdac8df20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453372:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9400/0x5bf8706fdac8df20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453376:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac9400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574551.453380:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9400/0x5bf8706fdac8df20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453385:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9400/0x5bf8706fdac8df20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453392:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c85c3ba6200) 00010000:00010000:3.0:1788574551.453394:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574551.453397:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9400/0x5bf8706fdac8df20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453402:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9400/0x5bf8706fdac8df20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453449:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9e00/0x5bf8706fdac8df12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e1d expref: 8 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453476:0:22629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9000/0x5bf8706fdac8df27 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e1d expref: 7 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.453485:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c85c3ba6300) 00010000:00010000:3.0:1788574551.453487:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574551.453748:0:22629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85f7ac9000, rc 0) 00000100:00100000:3.0:1788574551.454079:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+7:18740:x1875455669075200:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1694us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574551.454089:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:1.0:1788574551.459540:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574551.459632:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669075328 00000100:00100000:0.0:1788574551.459644:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669075328 00000100:00100000:0.0:1788574551.459700:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1788574551.459711:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1d716dac-67f1-439f-bc22-0390f9279eab+7:18740:x1875455669075328:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788574551.459804:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1d716dac-67f1-439f-bc22-0390f9279eab+7:18740:x1875455669075328:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574551.459812:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:2.0:1788574551.462116:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574551.462219:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669075584 00000100:00100000:0.0:1788574551.462228:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669075584 00000100:00100000:0.0:1788574551.462289:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:0.0:1788574551.462307:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d716dac-67f1-439f-bc22-0390f9279eab+7:18740:x1875455669075584:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574551.462327:0:24885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574551.462349:0:24885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8df2e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e24 expref: -99 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.462428:0:24885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df35 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.462443:0:24885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df35 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.462455:0:24885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df35 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.462471:0:24885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df3c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.462491:0:24885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.462498:0:24885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.462606:0:24885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8df43 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.462615:0:24885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8df43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.462622:0:24885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8df43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574551.462632:0:24885:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788574551.463471:0:24885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df35 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.463487:0:24885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df35 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.463494:0:24885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df35 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.463499:0:24885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574551.463503:0:24885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df35 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.463511:0:24885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df35 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.463538:0:24885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c85c3ba6300) 00010000:00010000:0.0:1788574551.463541:0:24885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574551.463546:0:24885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df35 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.463552:0:24885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df35 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.463567:0:24885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.463572:0:24885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df3c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.463577:0:24885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df3c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.463582:0:24885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574551.463585:0:24885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df3c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.463591:0:24885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df3c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.463598:0:24885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c85d07b8c00) 00010000:00010000:0.0:1788574551.463600:0:24885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574551.463603:0:24885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df3c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.463622:0:24885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df3c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.470225:0:24885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8df2e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e24 expref: 10 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.470257:0:24885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8df43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e24 expref: 9 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.470267:0:24885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c85d07b8600) 00010000:00010000:0.0:1788574551.470270:0:24885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574551.470274:0:24885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6000, rc 0) 00000100:00100000:0.0:1788574551.470358:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d716dac-67f1-439f-bc22-0390f9279eab+9:18740:x1875455669075584:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 8060us (8251us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788574551.470367:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:3.0:1788574551.479308:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574551.479950:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669075712 00000100:00100000:2.0:1788574551.479961:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669075712 00000100:00100000:2.0:1788574551.480020:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:2.0:1788574551.480029:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d716dac-67f1-439f-bc22-0390f9279eab+9:18740:x1875455669075712:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788574551.480148:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d716dac-67f1-439f-bc22-0390f9279eab+9:18740:x1875455669075712:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 119us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574551.480156:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:1.0:1788574551.491385:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574551.494884:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669075840 00000100:00100000:3.0:1788574551.494903:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669075840 00000100:00100000:2.0:1788574551.496767:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:2.0:1788574551.496785:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+5:18740:x1875455669075840:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788574551.501899:0:22629:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5063us 00000100:00080000:1.0:1788574551.504151:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788574551.531659:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+5:18740:x1875455669075840:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 34870us (40272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574551.531676:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 10000000:01000000:2.0:1788574551.571720:0:22624:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788574551.571727:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85f7a09800 from 13 10000000:01000000:2.0:1788574551.571732:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574551.571781:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f000/0x5bf8706fdac8df51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.571812:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f000/0x5bf8706fdac8df51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.571825:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f000/0x5bf8706fdac8df51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574551.571862:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681774848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574551.571938:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574551.571984:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c7de69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574551.572038:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681774848 00000100:00100000:3.0:1788574551.572045:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681774848 00000100:00100000:3.0:1788574551.572097:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788574551.572105:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+20:22624:x1875455681774848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574551.572117:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574551.572129:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85f7ac9400/0x5bf8706fdac8df58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8df51 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.572151:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85f7ac9400/0x5bf8706fdac8df58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8df51 expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.572162:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85f7ac9400/0x5bf8706fdac8df58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8df51 expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.572171:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85f7ac9400, rc 0) 00000100:00100000:3.0:1788574551.572258:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+21:22624:x1875455681774848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574551.572265:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00010000:00010000:0.0:1788574551.572588:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574551.572645:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681774848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574551.572660:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f000/0x5bf8706fdac8df51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8df58 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.572670:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f000/0x5bf8706fdac8df51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8df58 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574551.572728:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681774976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574551.572754:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574551.572785:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c7de69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574551.572842:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681774976 00000100:00100000:1.0:1788574551.572854:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681774976 00000100:00100000:1.0:1788574551.572891:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788574551.572900:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:22624:x1875455681774976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574551.573022:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:22624:x1875455681774976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574551.573029:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788574551.573063:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681774976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574551.573092:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681775104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574551.573132:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574551.573144:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574551.573155:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681775104 00000100:00100000:1.0:1788574551.573158:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681775104 00000100:00100000:1.0:1788574551.573174:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788574551.573180:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:22624:x1875455681775104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574551.573632:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+21:22624:x1875455681775104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 450us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574551.573645:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788574551.573738:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681775104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574551.581591:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574551.581786:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669075968 00000100:00100000:0.0:1788574551.581796:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669075968 00000100:00100000:0.0:1788574551.581865:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:0.0:1788574551.581876:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d716dac-67f1-439f-bc22-0390f9279eab+9:18746:x1875455669075968:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574551.581897:0:24885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574551.581919:0:24885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8df5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e2b expref: -99 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.581988:0:24885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582003:0:24885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582029:0:24885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582085:0:24885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582093:0:24885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582100:0:24885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582142:0:24885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582149:0:24885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df66 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582155:0:24885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582160:0:24885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574551.582163:0:24885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582169:0:24885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582180:0:24885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:0.0:1788574551.582183:0:24885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574551.582237:0:24885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582252:0:24885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8df66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582265:0:24885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582272:0:24885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582277:0:24885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582281:0:24885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574551.582283:0:24885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582288:0:24885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582305:0:24885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c85d07b8c00) 00010000:00010000:0.0:1788574551.582308:0:24885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574551.582311:0:24885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df6d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582316:0:24885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8df6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582350:0:24885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8df5f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e2b expref: 10 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582373:0:24885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:0.0:1788574551.582376:0:24885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574551.582380:0:24885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8df5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e2b expref: 10 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.582389:0:24885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6e00, rc 0) 00000100:00100000:0.0:1788574551.582449:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d716dac-67f1-439f-bc22-0390f9279eab+9:18746:x1875455669075968:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 575us (869us total) trans 0 rc 301/301 00000100:00100000:0.0:1788574551.582456:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000040:00080000:2.0:1788574551.585769:0:25672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788574551.586654:0:22624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788574551.586683:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574551.586695:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f000/0x5bf8706fdac8df51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8df58 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.586710:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f000/0x5bf8706fdac8df51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8df58 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574551.586722:0:22624:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788574551.586725:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c84c3ecb000 from 13 10000000:01000000:1.0:1788574551.586727:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574551.586775:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8df74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.586784:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8df74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.586796:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8df74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574551.586821:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681775232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574551.586891:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574551.586944:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574551.587006:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681775232 00000100:00100000:0.0:1788574551.587014:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681775232 00000100:00100000:0.0:1788574551.587060:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788574551.587069:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+21:22624:x1875455681775232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574551.587082:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574551.587094:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d7c00/0x5bf8706fdac8df7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8df74 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.587117:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d7c00/0x5bf8706fdac8df7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8df74 expref: 22 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.587129:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d7c00/0x5bf8706fdac8df7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8df74 expref: 22 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.587137:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7c00, rc 0) 00000100:00100000:0.0:1788574551.587274:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+22:22624:x1875455681775232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574551.587312:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788574551.587438:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681775232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574551.587453:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8df74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8df7b expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.587462:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8df74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8df7b expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574551.587597:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681775360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574551.587626:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574551.587702:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788574551.587743:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681775360 00000100:00100000:2.0:1788574551.587750:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681775360 00000100:00100000:2.0:1788574551.587821:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788574551.587829:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+22:22624:x1875455681775360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574551.587987:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+22:22624:x1875455681775360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574551.587995:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788574551.588069:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681775360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574551.588097:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681775488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574551.588140:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574551.588162:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574551.588235:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681775488 00000100:00100000:0.0:1788574551.588240:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681775488 00000100:00100000:0.0:1788574551.588269:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788574551.588277:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+22:22624:x1875455681775488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574551.588369:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+22:22624:x1875455681775488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574551.588375:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788574551.588491:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681775488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788574551.589314:0:25673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788574551.589455:0:22624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788574551.589533:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574551.589543:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8df74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8df7b expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.589553:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8df74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8df7b expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574551.589564:0:22624:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788574551.589566:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85fa0fa800 from 13 10000000:01000000:1.0:1788574551.589569:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574551.589599:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8df82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.589606:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8df82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.589614:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8df82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574551.589642:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681775616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574551.589691:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574551.589730:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574551.589779:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681775616 00000100:00100000:0.0:1788574551.589786:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681775616 00000100:00100000:0.0:1788574551.589825:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788574551.589834:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+22:22624:x1875455681775616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574551.589845:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574551.589857:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8df89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8df82 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.589880:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8df89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8df82 expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.589891:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d6a00/0x5bf8706fdac8df89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8df82 expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.589901:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6a00, rc 0) 00000100:00100000:0.0:1788574551.589950:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+23:22624:x1875455681775616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574551.589956:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788574551.590080:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681775616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574551.590093:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8df82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8df89 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.590102:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8df82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8df89 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574551.590151:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681775744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574551.590176:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574551.590223:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574551.590287:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681775744 00000100:00100000:0.0:1788574551.590291:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681775744 00000100:00100000:0.0:1788574551.590371:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788574551.590378:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+23:22624:x1875455681775744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574551.590491:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+23:22624:x1875455681775744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574551.590498:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788574551.590557:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681775744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574551.590590:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681775872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574551.590629:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574551.590658:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788574551.590705:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681775872 00000100:00100000:2.0:1788574551.590709:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681775872 00000100:00100000:2.0:1788574551.590742:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788574551.590750:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+23:22624:x1875455681775872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574551.590943:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a90d265-af03-4b80-95da-0de9cffed3f2+23:22624:x1875455681775872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574551.590950:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788574551.591005:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681775872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574551.591611:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000040:00080000:0.0:1788574551.592017:0:25674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788574551.592185:0:22624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788574551.592342:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574551.592352:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8df82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8df89 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.592437:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8df82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8df89 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574551.592458:0:22624:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788574551.592460:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c84c2291800 from 13 10000000:01000000:1.0:1788574551.592463:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574551.592498:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8df90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.592507:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8df90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.592517:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8df90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574551.592539:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681776000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574551.592584:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574551.592619:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788574551.592719:0:22636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669076096 00000100:00100000:2.0:1788574551.592725:0:22636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669076096 00000100:00100000:2.0:1788574551.592839:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1788574551.592849:0:22636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1d716dac-67f1-439f-bc22-0390f9279eab+9:18746:x1875455669076096:12345-192.168.204.51@tcp:700:lfs.0 00000100:00100000:2.0:1788574551.592922:0:22636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1d716dac-67f1-439f-bc22-0390f9279eab+9:18746:x1875455669076096:12345-192.168.204.51@tcp:700:lfs.0 Request processed in 75us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574551.592930:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1788574551.594552:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681776000 00000100:00100000:3.0:1788574551.594568:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681776000 00000100:00100000:3.0:1788574551.594659:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788574551.594668:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+23:22624:x1875455681776000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574551.594683:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574551.594700:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85f7ac9e00/0x5bf8706fdac8df97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8df90 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.594727:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85f7ac9e00/0x5bf8706fdac8df97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8df90 expref: 24 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.594737:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85f7ac9e00/0x5bf8706fdac8df97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8df90 expref: 24 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.594745:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85f7ac9e00, rc 0) 00000100:00100000:3.0:1788574551.594818:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+24:22624:x1875455681776000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574551.594824:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788574551.594961:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681776000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574551.594983:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8df90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8df97 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.594993:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8df90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8df97 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574551.595066:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681776128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574551.595099:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574551.595288:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788574551.595445:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681776128 00000100:00100000:2.0:1788574551.595450:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681776128 00000100:00100000:3.0:1788574551.595503:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788574551.595512:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+24:22624:x1875455681776128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574551.595628:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a90d265-af03-4b80-95da-0de9cffed3f2+24:22624:x1875455681776128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574551.595635:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788574551.595713:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681776128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574551.595740:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681776256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574551.595790:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574551.595811:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574551.595853:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681776256 00000100:00100000:0.0:1788574551.595858:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681776256 00000100:00100000:0.0:1788574551.595879:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788574551.595885:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+24:22624:x1875455681776256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574551.595967:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+24:22624:x1875455681776256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574551.595973:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788574551.596044:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a90d265-af03-4b80-95da-0de9cffed3f2:22624:1875455681776256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788574551.596962:0:25675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788574551.597116:0:22624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788574551.597136:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788574551.597144:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8df90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8df97 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.597154:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8df90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8df97 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574551.597738:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574551.597801:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669076352 00000100:00100000:2.0:1788574551.597808:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669076352 00000100:00100000:2.0:1788574551.597857:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:2.0:1788574551.597866:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d716dac-67f1-439f-bc22-0390f9279eab+9:18746:x1875455669076352:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:2.0:1788574551.597917:0:23650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574551.597945:0:23650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8deb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d98 expref: 9 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.597977:0:23650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:2.0:1788574551.597982:0:23650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788574551.598040:0:23650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8df9e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.598053:0:23650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8def6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e08 expref: 5 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.598062:0:23650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8df9e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.598093:0:23650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8def6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e08 expref: 5 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.598108:0:23650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8def6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e08 expref: 5 pid: 23650 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574551.598121:0:23650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23650:1875455681776384:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574551.598523:0:23650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c250f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574551.602929:0:23650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23650:1875455681776384:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574551.602965:0:23650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8df9e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574551.603029:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574551.603080:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669076480 00000100:00100000:0.0:1788574551.603100:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669076480 00010000:00010000:0.0:1788574551.603186:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8def6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e08 expref: 6 pid: 23650 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574551.603283:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:0.0:1788574551.603293:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:2394:x1875455669076480:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574551.603322:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574551.603461:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8def6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e08 expref: 6 pid: 23650 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.603475:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8def6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e08 expref: 6 pid: 23650 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.603500:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8def6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e08 expref: 6 pid: 23650 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.603520:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:0.0:1788574551.603524:0:22612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8df9e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788574551.603527:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788574551.603535:0:22612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8df9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.603543:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8df9e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.603576:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788574551.603592:0:23650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8df9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.603599:0:23650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8df9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.603623:0:23650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8dfa5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574551.603635:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+5:2394:x1875455669076480:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 343us (607us total) trans 0 rc 0/0 00010000:00010000:2.0:1788574551.603644:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8dfa5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.603653:0:23650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8dfa5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574551.603653:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00010000:00010000:2.0:1788574551.605762:0:23650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e800/0x5bf8706fdac8dfac lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.605786:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e800/0x5bf8706fdac8dfac lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.605798:0:23650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e800/0x5bf8706fdac8dfac lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574551.605815:0:23650:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e30fa6e4 reply state 00000000b94b60d8 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e800/0x5bf8706fdac8dfac lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.605826:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e800/0x5bf8706fdac8dfac lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.605834:0:23650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:2.0:1788574551.605837:0:23650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788574551.605842:0:23650:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788574551.605847:0:23650:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788574551.605855:0:23650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8df9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.605861:0:23650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8df9e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.605868:0:23650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8df9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.605880:0:23650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32ea00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574551.605885:0:23650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8df9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.605893:0:23650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8df9e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.605904:0:23650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:2.0:1788574551.605907:0:23650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574551.605910:0:23650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8df9e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.605916:0:23650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8df9e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574551.605935:0:23650:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e30fa6e4 reply state 00000000b94b60d8 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8dfa5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.605943:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8dfa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.605949:0:23650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c85d20f2900) 00010000:00010000:2.0:1788574551.605951:0:23650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788574551.605953:0:23650:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788574551.606069:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d716dac-67f1-439f-bc22-0390f9279eab+10:18746:x1875455669076352:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 8193us (8323us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788574551.606078:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:1.0:1788574551.726547:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574551.726769:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669076608 00000100:00100000:2.0:1788574551.726781:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669076608 00000100:00100000:2.0:1788574551.726852:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:2.0:1788574551.726880:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+10:18754:x1875455669076608:12345-192.168.204.51@tcp:101:lctl.0 00010000:00010000:2.0:1788574551.726908:0:22629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574551.726942:0:22629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8dfb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e32 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.727021:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8dfba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.727036:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8dfba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.727048:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8dfba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574551.727090:0:22629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788574551.727094:0:22629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788574551.727136:0:22629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8dfba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.727161:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8dfb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e32 expref: 12 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.727180:0:22629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8dfba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e32 expref: 11 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.727238:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:2.0:1788574551.727242:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788574551.727245:0:22629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f400, rc 0) 00000100:00100000:2.0:1788574551.727322:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+11:18754:x1875455669076608:12345-192.168.204.51@tcp:101:lctl.0 Request processed in 444us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574551.727339:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:1.0:1788574551.774152:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574551.774261:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669076736 00000100:00100000:2.0:1788574551.774272:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669076736 00000100:00100000:2.0:1788574551.774340:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:2.0:1788574551.774349:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+5:18755:x1875455669076736:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788574551.774370:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574551.774389:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8dfc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e39 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.774451:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8dfc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.774465:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8dfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.774489:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8dfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574551.774533:0:22627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788574551.774537:0:22627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788574551.774555:0:22627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8dfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.774577:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8dfc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e39 expref: 7 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.774595:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8dfc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e39 expref: 6 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.774622:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:2.0:1788574551.774626:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788574551.774630:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32fa00, rc 0) 00000100:00100000:2.0:1788574551.774821:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:18755:x1875455669076736:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 471us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574551.774828:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:1.0:1788574551.779914:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574551.780032:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669076864 00000100:00100000:2.0:1788574551.780043:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669076864 00000100:00100000:2.0:1788574551.780109:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:2.0:1788574551.780120:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:18755:x1875455669076864:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788574551.780143:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574551.780167:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8dfcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e40 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780258:0:23650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8dfd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780274:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8dfd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780287:0:23650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8dfd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780312:0:23650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8dfdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780321:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8dfdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780347:0:23650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8dfdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780428:0:23650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8dfe4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780436:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8dfe4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780445:0:23650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8dfe4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574551.780501:0:23650:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788574551.780505:0:23650:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788574551.780526:0:23650:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8dfe4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780538:0:23650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8dfd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780544:0:23650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8dfd6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780551:0:23650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8dfd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780557:0:23650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574551.780561:0:23650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8dfd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780568:0:23650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8dfd6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780591:0:23650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:2.0:1788574551.780594:0:23650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574551.780599:0:23650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8dfd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780605:0:23650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8dfd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780617:0:23650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8dfdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780622:0:23650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8dfdd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780628:0:23650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8dfdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780633:0:23650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574551.780636:0:23650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8dfdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780641:0:23650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8dfdd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780647:0:23650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c85d20f2900) 00010000:00010000:2.0:1788574551.780649:0:23650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574551.780652:0:23650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8dfdd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780657:0:23650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8dfdd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780826:0:23650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8dfcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e40 expref: 8 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780839:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8dfe4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e40 expref: 7 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.780847:0:23650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:2.0:1788574551.780849:0:23650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788574551.780851:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e000, rc 0) 00000100:00100000:2.0:1788574551.780921:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+7:18755:x1875455669076864:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 803us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574551.780928:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:3.0:1788574551.795244:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574551.795313:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669076992 00000100:00100000:0.0:1788574551.795325:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669076992 00000100:00100000:0.0:1788574551.795481:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1788574551.795493:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+5:18755:x1875455669076992:12345-192.168.204.51@tcp:900:lfs.0 00000100:00100000:0.0:1788574551.795583:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+5:18755:x1875455669076992:12345-192.168.204.51@tcp:900:lfs.0 Request processed in 93us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574551.795592:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00080000:1.0:1788574551.795654:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788574551.799087:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574551.799327:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669077248 00000100:00100000:0.0:1788574551.799339:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669077248 00000100:00100000:0.0:1788574551.799451:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:0.0:1788574551.799461:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+7:18755:x1875455669077248:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574551.799492:0:24885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574551.799516:0:24885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8dfeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e47 expref: -99 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574551.799627:0:24885:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788574551.799754:0:24885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8dfeb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e47 expref: 9 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.799769:0:24885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:0.0:1788574551.799772:0:24885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574551.799779:0:24885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8dfeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e47 expref: 9 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.799793:0:24885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7000, rc 0) 00000100:00100000:0.0:1788574551.799918:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+8:18755:x1875455669077248:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 453us (833us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1788574551.799926:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:3.0:1788574551.806443:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574551.807024:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669077504 00000100:00100000:1.0:1788574551.807036:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669077504 00000100:00100000:1.0:1788574551.807163:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:1.0:1788574551.807174:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+8:18755:x1875455669077504:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:1.0:1788574551.807265:0:22628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574551.807305:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8dfe4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e40 expref: 8 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.807329:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:1.0:1788574551.807334:0:22628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574551.807358:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8dff9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.807373:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8dff9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.807403:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8dff9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574551.807604:0:22628:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d3f1b95 reply state 000000005b61991b transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8dff9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.807618:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8dff9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.807625:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:1.0:1788574551.807629:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788574551.807632:0:22628:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788574551.807640:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788574551.807740:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+9:18755:x1875455669077504:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 568us (1307us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788574551.807748:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:3.0:1788574551.811639:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574551.811820:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669077760 00000100:00100000:0.0:1788574551.811830:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669077760 00000100:00100000:0.0:1788574551.811899:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:0.0:1788574551.811909:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+9:18755:x1875455669077760:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788574551.812225:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+10:18755:x1875455669077760:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 317us (594us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788574551.812234:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:3.0:1788574551.817974:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574551.818107:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669078016 00000100:00100000:0.0:1788574551.818118:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669078016 00000100:00100000:0.0:1788574551.818180:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:0.0:1788574551.818226:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+10:18755:x1875455669078016:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574551.818251:0:22629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574551.818272:0:22629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e000 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e4e expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818359:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e007 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818376:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e007 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818386:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e007 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818396:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e00e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818418:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e00e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818426:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e00e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574551.818537:0:22629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788574551.818613:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e007 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818622:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e007 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818628:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e007 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818634:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574551.818638:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e007 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818646:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e007 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818658:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:0.0:1788574551.818661:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574551.818665:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e007 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818671:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e007 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818696:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e00e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818702:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e00e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818708:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e00e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818713:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574551.818715:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e00e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818721:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e00e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818730:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c85d20f2900) 00010000:00010000:0.0:1788574551.818732:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574551.818735:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e00e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818739:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e00e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818773:0:22629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e000 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e4e expref: 12 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818783:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:0.0:1788574551.818786:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574551.818796:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e000 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e4e expref: 12 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.818806:0:22629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7000, rc 0) 00000100:00100000:0.0:1788574551.818939:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+11:18755:x1875455669078016:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 750us (980us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788574551.818947:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:1.0:1788574551.821836:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574551.821966:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669078144 00000100:00100000:0.0:1788574551.821978:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669078144 00000100:00100000:0.0:1788574551.822046:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:0.0:1788574551.822056:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+11:18755:x1875455669078144:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574551.822082:0:24885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574551.822102:0:24885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e01c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e55 expref: -99 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.822227:0:24885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e023 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.822243:0:24885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e023 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.822255:0:24885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e023 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574551.822281:0:24885:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788574551.822286:0:24885:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574551.822318:0:24885:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e023 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.822345:0:24885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e01c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e55 expref: 13 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.822378:0:24885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e023 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e55 expref: 12 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.822388:0:24885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:0.0:1788574551.822391:0:24885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574551.822394:0:24885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6800, rc 0) 00000100:00100000:0.0:1788574551.822457:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+12:18755:x1875455669078144:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 403us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574551.822464:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:3.0:1788574551.828839:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574551.828924:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669078272 00000100:00100000:0.0:1788574551.828940:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669078272 00000100:00100000:0.0:1788574551.828999:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:0.0:1788574551.829010:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+12:18755:x1875455669078272:12345-192.168.204.51@tcp:37:lfs.0 00000100:00100000:0.0:1788574551.833580:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+12:18755:x1875455669078272:12345-192.168.204.51@tcp:37:lfs.0 Request processed in 4560us (4740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574551.833595:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:1.0:1788574551.837441:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574551.837578:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669078528 00000100:00100000:2.0:1788574551.837590:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669078528 00000100:00100000:2.0:1788574551.837688:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:2.0:1788574551.837700:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b2e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+12:18755:x1875455669078528:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788574551.837954:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b2e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+13:18755:x1875455669078528:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 249us (517us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788574551.837963:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000040:00080000:0.0:1788574551.893993:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788574551.906806:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574551.906966:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669078656 00000100:00100000:1.0:1788574551.906978:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669078656 00000100:00100000:1.0:1788574551.907048:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:1.0:1788574551.907058:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+11:18761:x1875455669078656:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788574551.907077:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574551.907098:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616c00/0x5bf8706fdac8e02a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e5c expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907171:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8e031 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907451:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8e031 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907463:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8e031 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907476:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8e038 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907483:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8e038 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907490:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8e038 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907580:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8e03f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907589:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8e03f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907597:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8e03f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574551.907632:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788574551.907636:0:22628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574551.907675:0:22628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8e03f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907687:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8e031 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907703:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8e031 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907710:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8e031 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907716:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574551.907721:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8e031 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907729:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8e031 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907741:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:1.0:1788574551.907744:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574551.907749:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8e031 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907755:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8e031 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907769:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8e038 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907776:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8e038 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907781:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8e038 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907786:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574551.907795:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8e038 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907802:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8e038 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907810:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c85d20f2900) 00010000:00010000:1.0:1788574551.907813:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574551.907816:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8e038 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.907822:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8e038 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.908407:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616c00/0x5bf8706fdac8e02a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e5c expref: 13 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.908425:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8e03f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e5c expref: 12 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.908432:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:1.0:1788574551.908435:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788574551.908437:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616000, rc 0) 00000100:00100000:1.0:1788574551.908522:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+12:18761:x1875455669078656:12345-192.168.204.51@tcp:101:bash.0 Request processed in 1465us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574551.908530:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:3.0:1788574551.913059:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574551.913237:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669078784 00000100:00100000:2.0:1788574551.913248:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669078784 00000100:00100000:2.0:1788574551.913314:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1788574551.913324:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1d716dac-67f1-439f-bc22-0390f9279eab+5:18761:x1875455669078784:12345-192.168.204.51@tcp:900:bash.0 00000100:00100000:2.0:1788574551.913419:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1d716dac-67f1-439f-bc22-0390f9279eab+5:18761:x1875455669078784:12345-192.168.204.51@tcp:900:bash.0 Request processed in 97us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574551.913446:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1788574551.916911:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574551.917140:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669079040 00000100:00100000:0.0:1788574551.917152:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669079040 00000100:00100000:0.0:1788574551.917251:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:0.0:1788574551.917260:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d716dac-67f1-439f-bc22-0390f9279eab+12:18761:x1875455669079040:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788574551.917282:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574551.917312:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e046 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e63 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.917447:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e04d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.917464:0:22627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e023 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e55 expref: 12 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.917472:0:22627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e04d lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.917509:0:22627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e023 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e55 expref: 12 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.917525:0:22627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e023 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e55 expref: 12 pid: 24885 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574551.917540:0:22627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22627:1875455681776512:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574551.917630:0:22627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c376ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574551.922756:0:22627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22627:1875455681776512:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574551.922797:0:22627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e04d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574551.924541:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574551.924834:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669079168 00000100:00100000:3.0:1788574551.924853:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669079168 00010000:00010000:3.0:1788574551.924898:0:22614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e023 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e55 expref: 13 pid: 24885 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574551.924939:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:3.0:1788574551.924957:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+13:2393:x1875455669079168:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574551.924971:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574551.924978:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e023 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e55 expref: 13 pid: 24885 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.924992:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e023 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e55 expref: 13 pid: 24885 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.925014:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e023 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e55 expref: 13 pid: 24885 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.925031:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:3.0:1788574551.925570:0:22614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e04d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.925586:0:22614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e04d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.925606:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e04d lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574551.925638:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574551.925701:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+12:2393:x1875455669079168:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 752us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574551.925709:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00010000:00010000:0.0:1788574551.925767:0:22627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e04d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.925775:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e04d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.925832:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e054 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.925857:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e054 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.925865:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e054 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.926426:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e05b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.926437:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e05b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.926444:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e05b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574551.926455:0:22627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788574551.926480:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e04d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.926487:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e04d lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.926493:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e04d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.926499:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574551.926503:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e04d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.926510:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e04d lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.926531:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:0.0:1788574551.926534:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574551.926538:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e04d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.926543:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e04d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574551.926554:0:22627:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf747422 reply state 000000003c6f2a13 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e054 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.926563:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e054 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.926570:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9c85d07b8c00) 00010000:00010000:0.0:1788574551.926572:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788574551.926575:0:22627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788574551.926610:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e046 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e63 expref: 15 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.926626:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e05b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e63 expref: 14 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574551.926633:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:0.0:1788574551.926636:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788574551.926638:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6e00, rc 0) 00000100:00100000:0.0:1788574551.926677:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d716dac-67f1-439f-bc22-0390f9279eab+15:18761:x1875455669079040:12345-192.168.204.51@tcp:101:bash.0 Request processed in 9418us (9776us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788574551.926686:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:1.0:1788574551.947088:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574551.947347:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669079296 00000100:00100000:2.0:1788574551.947358:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669079296 00000100:00100000:2.0:1788574551.947418:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:2.0:1788574551.947429:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d716dac-67f1-439f-bc22-0390f9279eab+15:18761:x1875455669079296:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788574551.947454:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574551.947476:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8e069 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e6a expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.947555:0:23650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8e070 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.947571:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8e070 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.947584:0:23650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8e070 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574551.947635:0:23650:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788574551.947640:0:23650:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788574551.947662:0:23650:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8e070 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.947673:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8e070 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.947699:0:23650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8e069 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e6a expref: 17 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.947750:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8e070 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e6a expref: 16 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574551.947759:0:23650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:2.0:1788574551.947762:0:23650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574551.947766:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e600, rc 0) 00000100:00100000:2.0:1788574551.947827:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d716dac-67f1-439f-bc22-0390f9279eab+16:18761:x1875455669079296:12345-192.168.204.51@tcp:101:bash.0 Request processed in 400us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574551.947835:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:2.0:1788574551.951979:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574551.952125:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669079552 00000100:00100000:0.0:1788574551.952135:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669079552 00000100:00100000:0.0:1788574551.952220:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1788574551.952230:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d716dac-67f1-439f-bc22-0390f9279eab+16:18761:x1875455669079552:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:0.0:1788574551.952534:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d716dac-67f1-439f-bc22-0390f9279eab+17:18761:x1875455669079552:12345-192.168.204.51@tcp:35:bash.0 Request processed in 305us (566us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788574551.952542:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000040:00080000:0.0:1788574551.957202:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788574552.121631:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574552.121743:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669079808 00000100:00100000:0.0:1788574552.121756:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669079808 00000100:00100000:0.0:1788574552.121820:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:0.0:1788574552.121831:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+17:18771:x1875455669079808:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574552.121864:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574552.121889:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e71 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574552.121996:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788574552.122101:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e077 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e71 expref: 19 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.122118:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:0.0:1788574552.122122:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574552.122127:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e71 expref: 19 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.122141:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7400, rc 0) 00000100:00100000:0.0:1788574552.122582:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+18:18771:x1875455669079808:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 750us (958us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1788574552.122607:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:1.0:1788574552.131476:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574552.133966:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669080064 00000100:00100000:0.0:1788574552.133987:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669080064 00000100:00100000:0.0:1788574552.134064:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1788574552.144374:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d716dac-67f1-439f-bc22-0390f9279eab+18:18771:x1875455669080064:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788574552.144677:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d716dac-67f1-439f-bc22-0390f9279eab+19:18771:x1875455669080064:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 10599us (13209us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1788574552.144687:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:2.0:1788574552.248469:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574552.248673:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669080320 00000100:00100000:0.0:1788574552.248683:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669080320 00000100:00100000:0.0:1788574552.248741:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:0.0:1788574552.248750:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d716dac-67f1-439f-bc22-0390f9279eab+19:18774:x1875455669080320:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574552.248783:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574552.248803:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e085 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e78 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.248927:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e08c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.249229:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e08c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.249247:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e08c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574552.249259:0:22627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788574552.249518:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e085 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e78 expref: 22 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.249568:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e08c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e78 expref: 21 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.249578:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:0.0:1788574552.249581:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574552.249585:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7000, rc 0) 00000100:00100000:0.0:1788574552.249659:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d716dac-67f1-439f-bc22-0390f9279eab+21:18774:x1875455669080320:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 909us (1200us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788574552.249668:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:1.0:1788574552.256455:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574552.256524:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574552.256626:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669080448 00000100:00100000:2.0:1788574552.256633:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669080576 00000100:00100000:0.0:1788574552.256640:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669080448 00000100:00100000:2.0:1788574552.256641:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669080576 00000100:00100000:0.0:1788574552.256711:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:2.0:1788574552.256716:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:0.0:1788574552.256724:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+22:18774:x1875455669080448:12345-192.168.204.51@tcp:54:lfs.0 00000100:00100000:2.0:1788574552.256731:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d716dac-67f1-439f-bc22-0390f9279eab+22:2394:x1875455669080576:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574552.256753:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574552.256812:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e09a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.257324:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e08c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e78 expref: 22 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.259114:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e09a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.259140:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e09a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.259205:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e09a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.259213:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e09a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.259241:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e09a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.259246:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574552.259250:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e09a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.259258:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e09a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.259271:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:0.0:1788574552.259274:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574552.259279:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e09a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.259296:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e09a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574552.259474:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+21:18774:x1875455669080448:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 2749us (3028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574552.259484:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00010000:00010000:2.0:1788574552.260509:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:2.0:1788574552.260525:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574552.260586:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d716dac-67f1-439f-bc22-0390f9279eab+20:2394:x1875455669080576:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 3858us (4058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574552.260600:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1788574552.265724:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574552.265794:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669080832 00000100:00100000:0.0:1788574552.265805:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669080832 00000100:00100000:0.0:1788574552.265874:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1788574552.265885:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d716dac-67f1-439f-bc22-0390f9279eab+20:18774:x1875455669080832:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788574552.267488:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d716dac-67f1-439f-bc22-0390f9279eab+21:18774:x1875455669080832:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 1597us (1766us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788574552.267502:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00010000:00010000:2.0:1788574552.596061:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574552.657648:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574552.664213:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669081088 00000100:00100000:0.0:1788574552.664233:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669081088 00000100:00100000:0.0:1788574552.664333:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:0.0:1788574552.664345:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+21:18805:x1875455669081088:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:0.0:1788574552.664369:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574552.664390:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e0a1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e7f expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.664497:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8e0a8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.664512:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8e0a8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.664524:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8e0a8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574552.664536:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788574552.664661:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e0a1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e7f expref: 24 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.664681:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8e0a8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e7f expref: 23 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.664690:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:0.0:1788574552.664693:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574552.664711:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7600, rc 0) 00000100:00100000:0.0:1788574552.667848:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+23:18805:x1875455669081088:12345-192.168.204.51@tcp:101:cat.0 Request processed in 3482us (10186us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1788574552.667883:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:1.0:1788574552.676029:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574552.676583:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669081216 00000100:00100000:3.0:1788574552.676596:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669081216 00000100:00100000:3.0:1788574552.676667:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:3.0:1788574552.676678:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d716dac-67f1-439f-bc22-0390f9279eab+23:2393:x1875455669081216:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574552.676693:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574552.676727:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8e0a8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e7f expref: 23 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.676747:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:3.0:1788574552.676751:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574552.676811:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d716dac-67f1-439f-bc22-0390f9279eab+22:2393:x1875455669081216:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 135us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574552.676818:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:1.0:1788574552.677569:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574552.677635:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669081472 00000100:00100000:3.0:1788574552.677642:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669081472 00000100:00100000:3.0:1788574552.677678:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:3.0:1788574552.677687:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d716dac-67f1-439f-bc22-0390f9279eab+22:18805:x1875455669081472:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:3.0:1788574552.678661:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d716dac-67f1-439f-bc22-0390f9279eab+23:18805:x1875455669081472:12345-192.168.204.51@tcp:35:cat.0 Request processed in 968us (1088us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1788574552.678674:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:3.0:1788574552.723517:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574552.723549:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681776640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574552.723626:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574552.723723:0:25473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681776640 00000100:00100000:1.0:1788574552.723733:0:25473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681776640 00000100:00100000:1.0:1788574552.723801:0:25473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788574552.723811:0:25473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681776640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574552.723852:0:25473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788574552.723915:0:25473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681776640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574552.723923:0:25473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788574552.723941:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681776640:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788574552.724004:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574552.775427:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574552.775637:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669081728 00000100:00100000:2.0:1788574552.775649:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669081728 00000100:00100000:2.0:1788574552.775716:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:2.0:1788574552.775734:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d716dac-67f1-439f-bc22-0390f9279eab+23:18811:x1875455669081728:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:2.0:1788574552.775759:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574552.775781:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8e0b6 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e86 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.775903:0:23650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8e0bd lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.775919:0:23650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e05b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e63 expref: 24 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.775929:0:23650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8e070 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e6a expref: 24 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.775938:0:23650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8e0bd lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.775983:0:23650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8e070 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e6a expref: 24 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.775997:0:23650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8e070 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e6a expref: 24 pid: 23650 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574552.776010:0:23650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23650:1875455681776768:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574552.776242:0:23650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e05b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e63 expref: 24 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.776259:0:23650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e05b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e63 expref: 24 pid: 22627 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574552.776269:0:23650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f47800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23650:1875455681776896:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574552.776333:0:23650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c250f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788574552.789299:0:23650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23650:1875455681776768:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574552.798243:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574552.798307:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574552.799053:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669081856 00000100:00100000:3.0:1788574552.799065:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669081856 00010000:00010000:3.0:1788574552.799110:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8e070 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e6a expref: 25 pid: 23650 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574552.799152:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669081984 00000100:00100000:3.0:1788574552.799156:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669081984 00010000:00010000:3.0:1788574552.799169:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e05b lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e63 expref: 26 pid: 22627 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574552.799186:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1788574552.799230:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d716dac-67f1-439f-bc22-0390f9279eab+26:2394:x1875455669081856:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574552.799246:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574552.799252:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8e070 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e6a expref: 26 pid: 23650 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.799266:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8e070 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e6a expref: 26 pid: 23650 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.799302:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8e070 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e6a expref: 26 pid: 23650 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.799337:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:3.0:1788574552.799341:0:22612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8e0bd lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.799349:0:22612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8e0bd lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.799355:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574552.799408:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d716dac-67f1-439f-bc22-0390f9279eab+25:2394:x1875455669081856:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 180us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574552.799415:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1788574552.799432:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:3.0:1788574552.799438:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3266850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d716dac-67f1-439f-bc22-0390f9279eab+24:2393:x1875455669081984:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574552.799448:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574552.799453:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e05b lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e63 expref: 24 pid: 22627 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.799462:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e05b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e63 expref: 24 pid: 22627 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.799472:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:3.0:1788574552.799476:0:22612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8e0bd lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.799483:0:22612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8e0bd lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.799500:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8e0bd lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.799517:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574552.799537:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3266850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d716dac-67f1-439f-bc22-0390f9279eab+24:2393:x1875455669081984:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 100us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574552.799544:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00010000:00010000:2.0:1788574552.800140:0:23650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e05b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e63 expref: 23 pid: 22627 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574552.800159:0:23650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f47800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23650:1875455681776896:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574552.800185:0:23650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8e0bd lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.800226:0:23650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8e0bd lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.800232:0:23650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8e0bd lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574552.800253:0:23650:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788574552.800427:0:23650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8e0b6 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e86 expref: 24 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.800444:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8e0bd lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e86 expref: 23 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.800465:0:23650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:2.0:1788574552.800469:0:23650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788574552.800472:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32ea00, rc 0) 00000100:00100000:2.0:1788574552.800508:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d716dac-67f1-439f-bc22-0390f9279eab+23:18811:x1875455669081728:12345-192.168.204.51@tcp:101:dd.0 Request processed in 24782us (25090us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1788574552.800515:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:1.0:1788574552.810111:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574552.810402:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669082112 00000100:00100000:0.0:1788574552.810417:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669082112 00000100:00100000:0.0:1788574552.810479:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:0.0:1788574552.810489:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+23:18811:x1875455669082112:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:0.0:1788574552.810512:0:22629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574552.810535:0:22629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e0cb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e8d expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.810571:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8e0d2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.810591:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8e0d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.810604:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8e0d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.810869:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e0cb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e8d expref: 25 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.810891:0:22629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8e0d2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e8d expref: 24 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.810913:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:0.0:1788574552.810916:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788574552.810920:0:22629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7200, rc 0) 00000100:00100000:0.0:1788574552.811057:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+24:18811:x1875455669082112:12345-192.168.204.51@tcp:101:dd.0 Request processed in 569us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574552.811064:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:2.0:1788574552.820531:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574552.820777:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669082368 00000100:00100000:0.0:1788574552.820788:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669082368 00000100:00100000:0.0:1788574552.821046:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:0.0:1788574552.821304:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+24:18811:x1875455669082368:12345-192.168.204.51@tcp:36:dd.0 00010000:00010000:0.0:1788574552.821572:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e0d9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.821594:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e0d9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.821609:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e0d9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788574552.823247:0:22628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1788574552.823322:0:22628:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000620c237 reply state 0000000036fe6e2e transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e0d9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.823343:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e0d9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.823353:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:1.0:1788574552.823356:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788574552.823360:0:22628:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788574552.823571:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+27:18811:x1875455669082368:12345-192.168.204.51@tcp:36:dd.0 Request processed in 2270us (3047us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1788574552.823580:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000020:00080000:1.0:1788574552.823586:0:22628:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788574552.838021:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574552.838137:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669082496 00000100:00100000:2.0:1788574552.838148:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669082496 00000100:00100000:2.0:1788574552.838260:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:2.0:1788574552.838282:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d716dac-67f1-439f-bc22-0390f9279eab+27:18811:x1875455669082496:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:2.0:1788574552.838319:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574552.838342:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8e0e0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e94 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.838409:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8e0e0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e94 expref: 28 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.838425:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8e0e0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e94 expref: 28 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.838462:0:23650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:2.0:1788574552.838466:0:23650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788574552.838470:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e000, rc 0) 00000100:00100000:2.0:1788574552.838529:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d716dac-67f1-439f-bc22-0390f9279eab+28:18811:x1875455669082496:12345-192.168.204.51@tcp:101:dd.0 Request processed in 260us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574552.838549:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:3.0:1788574552.855598:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574552.855960:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669082752 00000100:00100000:0.0:1788574552.856074:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669082752 00000100:00100000:0.0:1788574552.856220:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:0.0:1788574552.856233:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d716dac-67f1-439f-bc22-0390f9279eab+28:18811:x1875455669082752:12345-192.168.204.51@tcp:103:dd.0 00010000:00010000:0.0:1788574552.856250:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574552.856289:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8e0e0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e94 expref: 28 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.856342:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:0.0:1788574552.856349:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574552.856422:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d716dac-67f1-439f-bc22-0390f9279eab+27:18811:x1875455669082752:12345-192.168.204.51@tcp:103:dd.0 Request processed in 191us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574552.856431:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:2.0:1788574552.859264:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574552.859724:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669082880 00000100:00100000:3.0:1788574552.859735:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669082880 00000100:00100000:3.0:1788574552.859922:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:3.0:1788574552.859933:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+27:18811:x1875455669082880:12345-192.168.204.51@tcp:58:dd.0 00010000:00010000:3.0:1788574552.860154:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8e0e7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.860172:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8e0e7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.860185:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8e0e7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788574552.861633:0:22629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788574552.861671:0:22629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1788574552.862083:0:22629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1788574552.862315:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+27:18811:x1875455669082880:12345-192.168.204.51@tcp:58:dd.0 Request processed in 2379us (3056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574552.862328:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:1.0:1788574552.868127:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574552.868241:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669083008 00000100:00100000:2.0:1788574552.868252:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669083008 00000100:00100000:2.0:1788574552.868320:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:2.0:1788574552.868330:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+27:18811:x1875455669083008:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:2.0:1788574552.868353:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574552.868375:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8e0ee lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6e9b expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.868436:0:22628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8e0e7 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.868449:0:22628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8e0ee lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e9b expref: 28 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.868470:0:22628:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8e0e7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.868484:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8e0ee lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e9b expref: 28 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.868499:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:2.0:1788574552.868502:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788574552.868506:0:22628:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8e0ee lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e9b expref: 28 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.868513:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e200, rc 0) 00000100:00100000:2.0:1788574552.868595:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+28:18811:x1875455669083008:12345-192.168.204.51@tcp:101:dd.0 Request processed in 265us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574552.868602:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00000040:00080000:0.0:1788574552.915566:0:22662:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788574552.915576:0:22662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788574552.915605:0:22662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788574552.915616:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788574552.915772:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22662:1875455681777024:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788574552.915876:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574552.922771:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574552.925911:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22662:1875455681777024:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788574552.926534:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669083136 00000100:00100000:2.0:1788574552.926544:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669083136 00000100:00100000:2.0:1788574552.926611:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:2.0:1788574552.926620:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d716dac-67f1-439f-bc22-0390f9279eab+28:18812:x1875455669083136:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788574552.926655:0:23650:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788574552.926809:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d716dac-67f1-439f-bc22-0390f9279eab+28:18812:x1875455669083136:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 189us (4048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574552.926816:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:1.0:1788574552.933603:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574552.933707:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669083264 00000100:00100000:3.0:1788574552.933724:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669083264 00000100:00100000:3.0:1788574552.933787:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:3.0:1788574552.933797:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+28:18812:x1875455669083264:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788574552.933893:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e0f5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.933913:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e0f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.933926:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e0f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.933985:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8e00/0x5bf8706fdac8e0fc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.933993:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8e00/0x5bf8706fdac8e0fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934000:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8e00/0x5bf8706fdac8e0fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934024:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9c00/0x5bf8706fdac8e103 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934033:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9c00/0x5bf8706fdac8e103 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934055:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9c00/0x5bf8706fdac8e103 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574552.934109:0:22629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788574552.934113:0:22629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788574552.934136:0:22629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9c00/0x5bf8706fdac8e103 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934150:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e0f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934156:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e0f5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934162:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e0f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934167:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac9800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574552.934171:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e0f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934178:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e0f5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934239:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c85d07b8600) 00010000:00010000:3.0:1788574552.934242:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574552.934247:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e0f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934253:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e0f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934267:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8e00/0x5bf8706fdac8e0fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934283:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8e00/0x5bf8706fdac8e0fc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934289:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8e00/0x5bf8706fdac8e0fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934302:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac8e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574552.934305:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8e00/0x5bf8706fdac8e0fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934311:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8e00/0x5bf8706fdac8e0fc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934320:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9c85c3ba6200) 00010000:00010000:3.0:1788574552.934322:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574552.934325:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8e00/0x5bf8706fdac8e0fc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934330:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8e00/0x5bf8706fdac8e0fc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934343:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9c00/0x5bf8706fdac8e103 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934348:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9c00/0x5bf8706fdac8e103 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934353:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9c00/0x5bf8706fdac8e103 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934357:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac9c00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574552.934360:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9c00/0x5bf8706fdac8e103 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934365:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9c00/0x5bf8706fdac8e103 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934384:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:3.0:1788574552.934386:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574552.934389:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9c00/0x5bf8706fdac8e103 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.934394:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9c00/0x5bf8706fdac8e103 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574552.934462:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+28:18812:x1875455669083264:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 665us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574552.934471:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:3.0:1788574552.938888:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574552.939075:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669083520 00000100:00100000:2.0:1788574552.939088:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669083520 00000100:00100000:2.0:1788574552.939241:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:2.0:1788574552.939253:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+28:18812:x1875455669083520:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574552.939287:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574552.939311:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8e10a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ea2 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.939435:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8e111 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.939451:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8e111 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.939463:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8e111 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574552.939494:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788574552.939581:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8e111 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.939590:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8e111 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.939597:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8e111 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.939604:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574552.939608:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8e111 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.939615:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8e111 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.939627:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:2.0:1788574552.939630:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788574552.939634:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8e111 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.939640:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8e111 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.939686:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8e10a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ea2 expref: 30 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.939695:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c85d07b8600) 00010000:00010000:2.0:1788574552.939697:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788574552.939707:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8e10a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ea2 expref: 30 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.939716:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e600, rc 0) 00000100:00100000:2.0:1788574552.939788:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+29:18812:x1875455669083520:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 538us (915us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1788574552.939807:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:1.0:1788574552.945851:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574552.945956:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669083648 00000100:00100000:0.0:1788574552.945966:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669083648 00000100:00100000:0.0:1788574552.946023:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:0.0:1788574552.946032:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d716dac-67f1-439f-bc22-0390f9279eab+29:18812:x1875455669083648:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788574552.946073:0:24885:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788574552.946182:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d716dac-67f1-439f-bc22-0390f9279eab+29:18812:x1875455669083648:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 151us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574552.946214:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:1.0:1788574552.958747:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574552.959649:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669083904 00000100:00100000:0.0:1788574552.959665:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669083904 00000100:00100000:0.0:1788574552.959732:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:0.0:1788574552.959742:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d716dac-67f1-439f-bc22-0390f9279eab+29:18812:x1875455669083904:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574552.959784:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574552.959809:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e11f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ea9 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788574552.960251:0:22627:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:0.0:1788574552.960259:0:22627:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:0.0:1788574552.960298:0:22627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:0.0:1788574552.960455:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8e126 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.960471:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8e126 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.960483:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8e126 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.960543:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e11f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ea9 expref: 32 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.960561:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8e126 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ea9 expref: 31 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.960570:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c85d07b8100) 00010000:00010000:0.0:1788574552.960572:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574552.960576:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6400, rc 0) 00000100:00100000:0.0:1788574552.960645:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d716dac-67f1-439f-bc22-0390f9279eab+31:18812:x1875455669083904:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 905us (1909us total) trans 12884901908 rc 0/0 00000100:00100000:0.0:1788574552.960652:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:2.0:1788574552.969124:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574552.969354:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669084160 00000100:00100000:1.0:1788574552.969365:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669084160 00000100:00100000:1.0:1788574552.969428:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:1.0:1788574552.969438:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+31:18812:x1875455669084160:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788574552.969498:0:22628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574552.969524:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8e126 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ea9 expref: 31 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969544:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c85d07b8100) 00010000:00010000:1.0:1788574552.969555:0:22628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574552.969580:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e134 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969601:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e134 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969611:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e134 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969668:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e13b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa2e9afce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969677:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e13b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa2e9afce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969683:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e13b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa2e9afce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969735:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e134 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969766:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e134 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969773:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e134 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969779:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574552.969784:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e134 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969792:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e134 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969802:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:1.0:1788574552.969805:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574552.969809:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e134 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969815:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e134 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969981:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e13b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa2e9afce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969988:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e13b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa2e9afce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969994:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e13b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa2e9afce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.969999:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574552.970009:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e13b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa2e9afce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.970016:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e13b lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa2e9afce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.970024:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xa2e9afce (ffff9c84c34efd00) 00010000:00010000:1.0:1788574552.970026:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574552.970029:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e13b lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa2e9afce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.970168:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e13b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa2e9afce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574552.970361:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+30:18812:x1875455669084160:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 923us (1245us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788574552.970370:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:0.0:1788574552.974642:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574552.974742:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669084288 00000100:00100000:3.0:1788574552.974752:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669084288 00000100:00100000:3.0:1788574552.974821:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:3.0:1788574552.974975:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+30:18812:x1875455669084288:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574552.975007:0:22629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574552.975031:0:22629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9c00/0x5bf8706fdac8e142 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6eb0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.975234:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8e00/0x5bf8706fdac8e149 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.975250:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8e00/0x5bf8706fdac8e149 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.975263:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8e00/0x5bf8706fdac8e149 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.975637:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9c00/0x5bf8706fdac8e142 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6eb0 expref: 32 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.975657:0:22629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8e00/0x5bf8706fdac8e149 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6eb0 expref: 31 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574552.975666:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:2.0:1788574552.975669:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788574552.975673:0:22629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85f7ac8e00, rc 0) 00000100:00100000:2.0:1788574552.975743:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+31:18812:x1875455669084288:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 912us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574552.975750:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:3.0:1788574552.979959:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574552.980055:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669084544 00000100:00100000:0.0:1788574552.980065:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669084544 00000100:00100000:0.0:1788574552.980125:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:0.0:1788574552.980136:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d716dac-67f1-439f-bc22-0390f9279eab+31:18812:x1875455669084544:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788574552.980255:0:23650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e150 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.980283:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e150 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.980296:0:23650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e150 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788574552.980496:0:23650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1788574552.980508:0:23650:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692960317976ns, next at 693960314709ns, rc = 0 00000004:00010000:0.0:1788574552.980572:0:23650:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffa64cc6 reply state 000000001c144671 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e150 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.980586:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e150 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.980593:0:23650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:0.0:1788574552.980596:0:23650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788574552.980599:0:23650:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574552.980697:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d716dac-67f1-439f-bc22-0390f9279eab+33:18812:x1875455669084544:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 562us (748us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1788574552.980705:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:2.0:1788574552.987884:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574552.987983:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669084672 00000100:00100000:1.0:1788574552.988110:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669084672 00000100:00100000:1.0:1788574552.988231:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:1.0:1788574552.988242:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+33:18812:x1875455669084672:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574552.988281:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574552.988302:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e157 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6eb7 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.988648:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e157 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6eb7 expref: 34 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.988666:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e157 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6eb7 expref: 34 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.988704:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:1.0:1788574552.988707:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574552.988712:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617000, rc 0) 00000100:00100000:1.0:1788574552.988786:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+34:18812:x1875455669084672:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 546us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574552.988794:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:3.0:1788574552.992049:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574552.992137:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669084800 00000100:00100000:2.0:1788574552.992146:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669084800 00000100:00100000:2.0:1788574552.992236:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:2.0:1788574552.992246:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d716dac-67f1-439f-bc22-0390f9279eab+5:2394:x1875455669084800:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788574552.992537:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d716dac-67f1-439f-bc22-0390f9279eab+6:2394:x1875455669084800:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 291us (508us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788574552.992567:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00080000:3.0:1788574552.992774:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574552.995678:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574552.995973:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669085056 00000100:00100000:0.0:1788574552.995986:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669085056 00000100:00100000:0.0:1788574552.996170:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:0.0:1788574552.996239:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d716dac-67f1-439f-bc22-0390f9279eab+34:18812:x1875455669085056:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788574552.996515:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d716dac-67f1-439f-bc22-0390f9279eab+35:18812:x1875455669085056:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 280us (852us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1788574552.996523:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1788574553.000379:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574553.000458:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669085312 00000100:00100000:1.0:1788574553.000468:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669085312 00000100:00100000:1.0:1788574553.000545:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:1.0:1788574553.000556:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+35:18812:x1875455669085312:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788574553.000660:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+35:18812:x1875455669085312:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 107us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574553.000668:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00080000:2.0:1788574553.000729:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574553.004105:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574553.004262:0:24885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669085440 00000100:00100000:0.0:1788574553.004286:0:24885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669085440 00000100:00100000:0.0:1788574553.004359:0:24885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:0.0:1788574553.004369:0:24885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d716dac-67f1-439f-bc22-0390f9279eab+35:18812:x1875455669085440:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574553.004391:0:24885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574553.004412:0:24885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e15e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ebe expref: -99 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.004484:0:24885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e165 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.004500:0:24885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e165 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.004513:0:24885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e165 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574553.004559:0:24885:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574553.004578:0:24885:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e165 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.004608:0:24885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8e15e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ebe expref: 37 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.004625:0:24885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e165 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ebe expref: 36 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.004648:0:24885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:0.0:1788574553.004651:0:24885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788574553.004655:0:24885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6800, rc 0) 00000100:00100000:0.0:1788574553.004717:0:24885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d716dac-67f1-439f-bc22-0390f9279eab+36:18812:x1875455669085440:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 349us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574553.004724:0:24885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:3.0:1788574553.009384:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574553.009610:0:24616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669085568 00000100:00100000:2.0:1788574553.009621:0:24616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669085568 00000100:00100000:2.0:1788574553.009687:0:24616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:2.0:1788574553.009697:0:24616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d716dac-67f1-439f-bc22-0390f9279eab+6:2393:x1875455669085568:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574553.009716:0:24616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574553.009739:0:24616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8e16c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ec5 expref: -99 pid: 24616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574553.009883:0:24616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b7b58, blocks: 0x0 00010000:00010000:2.0:1788574553.009909:0:24616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=692s v=(0 0) 00010000:00010000:2.0:1788574553.009914:0:24616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574553.009924:0:24616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8e16c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ec5 expref: 7 pid: 24616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.009945:0:24616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8e16c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ec5 expref: 7 pid: 24616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.009958:0:24616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217e800, rc 0) 00000100:00100000:2.0:1788574553.010166:0:24616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d716dac-67f1-439f-bc22-0390f9279eab+7:2393:x1875455669085568:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 469us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574553.010174:0:24616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:3.0:1788574553.013296:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574553.013406:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669085824 00000100:00100000:1.0:1788574553.013417:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669085824 00000100:00100000:1.0:1788574553.013530:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:1.0:1788574553.013542:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+36:18812:x1875455669085824:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788574553.013663:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+36:18812:x1875455669085824:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 123us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574553.013671:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:0.0:1788574553.016576:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574553.016896:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669085952 00000100:00100000:2.0:1788574553.016906:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669085952 00000100:00100000:2.0:1788574553.016969:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:2.0:1788574553.016979:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+36:18812:x1875455669085952:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788574553.023354:0:22607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:0.0:1788574553.023373:0:22607:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788574553.023423:0:22607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:1.0:1788574553.023534:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8dfa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023549:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8dfa5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023576:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8dfa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023583:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fe00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574553.023587:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8dfa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023596:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8dfa5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023616:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c85d20f2900) 00010000:00010000:1.0:1788574553.023620:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574553.023625:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8dfa5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023631:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8dfa5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023654:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e800/0x5bf8706fdac8dfac lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023661:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e800/0x5bf8706fdac8dfac lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023667:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e800/0x5bf8706fdac8dfac lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023672:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574553.023676:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e800/0x5bf8706fdac8dfac lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023693:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e800/0x5bf8706fdac8dfac lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023702:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:1.0:1788574553.023705:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574553.023708:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e800/0x5bf8706fdac8dfac lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023713:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e800/0x5bf8706fdac8dfac lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023727:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e054 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023732:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e054 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023737:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e054 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023742:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574553.023745:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e054 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023751:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e054 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023770:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9c85d07b8c00) 00010000:00010000:1.0:1788574553.023772:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574553.023775:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e054 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023787:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8e054 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023804:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e0d9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023810:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e0d9 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023816:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e0d9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023831:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574553.023835:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e0d9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023841:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e0d9 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023850:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:1.0:1788574553.023852:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574553.023855:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e0d9 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023860:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8e0d9 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023871:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e150 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023877:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e150 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023889:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e150 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023893:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574553.023896:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e150 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023903:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e150 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023911:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:1.0:1788574553.023913:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788574553.023916:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e150 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023922:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8e150 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023957:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8dff9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023963:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8dff9 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023968:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8dff9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.023972:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574553.023974:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8dff9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.024119:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8dff9 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.024130:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:1.0:1788574553.024132:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788574553.024134:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8dff9 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.024140:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8dff9 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574553.024576:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d716dac-67f1-439f-bc22-0390f9279eab+15:18812:x1875455669085952:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 7593us (8004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574553.024587:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:0.0:1788574553.024770:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681777152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788574553.024822:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574553.025825:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681777152 00000100:00100000:2.0:1788574553.025837:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681777152 00000100:00100000:2.0:1788574553.025910:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788574553.025920:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681777152:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788574553.026128:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1788574553.026486:0:24137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788574553.026490:0:24137:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788574553.026493:0:24137:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788574553.026495:0:24137:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788574552 -> 1788574552 00002000:00010000:2.0:1788574553.026497:0:24137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788574553.026572:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681777152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 654us (1748us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788574553.026580:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1788574553.028655:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c85c2f45180/2, rc 0, transno 12884901892 00000100:00100000:0.0:1788574553.028670:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681777152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788574553.029428:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574553.029498:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669086080 00000100:00100000:3.0:1788574553.029506:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669086080 00000100:00100000:3.0:1788574553.029556:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1788574553.029566:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d716dac-67f1-439f-bc22-0390f9279eab+7:2394:x1875455669086080:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788574553.029681:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d716dac-67f1-439f-bc22-0390f9279eab+7:2394:x1875455669086080:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 117us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574553.029690:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:2.0:1788574553.036334:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574553.036445:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669086336 00000100:00100000:0.0:1788574553.036456:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669086336 00000100:00100000:0.0:1788574553.036523:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:0.0:1788574553.036533:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d716dac-67f1-439f-bc22-0390f9279eab+15:18812:x1875455669086336:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788574553.036591:0:22627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574553.036617:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e165 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ebe expref: 15 pid: 24885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.036651:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:0.0:1788574553.036671:0:22627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574553.036705:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8e173 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.036719:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8e173 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.036730:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8e173 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574553.036886:0:22627:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031a36560 reply state 00000000a2edef8d transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8e173 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.036899:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8e173 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.036905:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:0.0:1788574553.036908:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788574553.036910:0:22627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574553.037016:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d716dac-67f1-439f-bc22-0390f9279eab+16:18812:x1875455669086336:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 483us (691us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1788574553.037025:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:0.0:1788574553.044330:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574553.044424:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669086464 00000100:00100000:2.0:1788574553.044435:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669086464 00000100:00100000:2.0:1788574553.044496:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:2.0:1788574553.044507:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d716dac-67f1-439f-bc22-0390f9279eab+7:18812:x1875455669086464:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574553.044530:0:24137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574553.044555:0:24137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8e17a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ecc expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.044608:0:24137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8e16c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ec5 expref: 8 pid: 24616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.044617:0:24137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788574553.044622:0:24137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574553.044627:0:24137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8e17a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ecc expref: 8 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.044661:0:24137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8e16c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ec5 expref: 8 pid: 24616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.044675:0:24137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8e16c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ec5 expref: 8 pid: 24616 timeout: 793 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574553.044689:0:24137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24137:1875455681777280:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574553.044791:0:24137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85f7abe6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574553.048871:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574553.049023:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669086592 00000100:00100000:1.0:1788574553.049047:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669086592 00010000:00010000:1.0:1788574553.049093:0:22614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8e16c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ec5 expref: 9 pid: 24616 timeout: 793 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574553.049138:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1788574553.049148:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d716dac-67f1-439f-bc22-0390f9279eab+9:2394:x1875455669086592:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574553.049163:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574553.049228:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8e16c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ec5 expref: 9 pid: 24616 timeout: 793 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.049246:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8e16c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ec5 expref: 9 pid: 24616 timeout: 793 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.049294:0:22614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574553.049299:0:22614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574553.049329:0:22614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8e17a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ecc expref: 9 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.049340:0:22614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8e17a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ecc expref: 9 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.049381:0:22614:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8e17a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ecc expref: 9 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574553.049396:0:22614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3d99880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:22614:1875455681777408:192.168.204.51@tcp:105: 00000100:00100000:1.0:1788574553.049486:0:22614:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ad80 going to sleep for 11 seconds 00010000:00010000:2.0:1788574553.050602:0:24137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066d8bbf5/0x5bf8706fdac8e16c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ec5 expref: 9 pid: 24616 timeout: 793 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574553.050623:0:24137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24137:1875455681777280:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574553.050648:0:24137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8e17a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ecc expref: 8 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.050678:0:24137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217e400, rc 0) 00000100:00100000:2.0:1788574553.050737:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d716dac-67f1-439f-bc22-0390f9279eab+8:18812:x1875455669086464:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 6231us (6415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574553.050745:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:3.0:1788574553.053363:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574553.053451:0:22614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3d99880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:22614:1875455681777408:192.168.204.51@tcp:105: 00010000:00010000:1.0:1788574553.053478:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574553.053538:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d716dac-67f1-439f-bc22-0390f9279eab+7:2394:x1875455669086592:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 4391us (4679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574553.053549:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:2.0:1788574553.053747:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669086720 00000100:00100000:2.0:1788574553.053755:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669086720 00000100:00100000:2.0:1788574553.053805:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:2.0:1788574553.053816:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d716dac-67f1-439f-bc22-0390f9279eab+7:2394:x1875455669086720:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788574553.053986:0:24136:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788574553.053990:0:24136:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788574552 00002000:00010000:2.0:1788574553.053993:0:24136:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788574551 00002000:00010000:2.0:1788574553.053996:0:24136:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788574552 -> 1788574552 00002000:00010000:2.0:1788574553.053998:0:24136:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788574553.054039:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d716dac-67f1-439f-bc22-0390f9279eab+8:2394:x1875455669086720:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 224us (686us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788574553.054047:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:3.0:1788574553.057160:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574553.057556:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669086848 00000100:00100000:2.0:1788574553.057566:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669086848 00000100:00100000:2.0:1788574553.057668:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:2.0:1788574553.057679:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d716dac-67f1-439f-bc22-0390f9279eab+8:2393:x1875455669086848:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788574553.057725:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8e181 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.057744:0:24138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8e17a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ecc expref: 8 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.057766:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574553.057770:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574553.057775:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8e181 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.057812:0:24138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8e17a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ecc expref: 8 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.057840:0:24138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8e17a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ecc expref: 8 pid: 24137 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574553.057855:0:24138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24138:1875455681777536:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574553.057944:0:24138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85f7abe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574553.063330:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574553.063496:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669086976 00000100:00100000:1.0:1788574553.063504:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669086976 00010000:00010000:1.0:1788574553.063546:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8e17a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ecc expref: 9 pid: 24137 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574553.063590:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:1.0:1788574553.063601:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d716dac-67f1-439f-bc22-0390f9279eab+9:2393:x1875455669086976:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574553.063617:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574553.063639:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8e17a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ecc expref: 9 pid: 24137 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.063668:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8e17a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ecc expref: 9 pid: 24137 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.063695:0:22613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574553.063699:0:22613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574553.063705:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8e181 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.063714:0:22613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8e181 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.063734:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574553.063791:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d716dac-67f1-439f-bc22-0390f9279eab+9:2393:x1875455669086976:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 192us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574553.063799:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00010000:00010000:2.0:1788574553.064787:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049cab748/0x5bf8706fdac8e17a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ecc expref: 8 pid: 24137 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574553.064809:0:24138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24138:1875455681777536:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574553.064891:0:24138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8e181 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.064902:0:24138:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8e181 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.064926:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8e181 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.064952:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8e181 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.064960:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8e181 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.064974:0:24138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8e181 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.064981:0:24138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217fa00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574553.064985:0:24138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8e181 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.064994:0:24138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8e181 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.065010:0:24138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8e181 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.065017:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000300d0dba/0x5bf8706fdac8e181 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574553.065372:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d716dac-67f1-439f-bc22-0390f9279eab+7:2393:x1875455669086848:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 7693us (8220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574553.065382:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:0.0:1788574553.070841:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574553.070954:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669087232 00000100:00100000:1.0:1788574553.070967:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669087232 00000100:00100000:1.0:1788574553.071344:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:1.0:1788574553.071365:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+16:18812:x1875455669087232:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788574553.071474:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e188 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.071494:0:22628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8e0d2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e8d expref: 16 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.071504:0:22628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e188 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.071559:0:22628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8e0d2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e8d expref: 16 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.071574:0:22628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8e0d2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e8d expref: 16 pid: 22629 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574553.071588:0:22628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3d99880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22628:1875455681777664:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574553.071737:0:22628:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574553.077582:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574553.077662:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669087360 00000100:00100000:3.0:1788574553.077672:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669087360 00010000:00010000:3.0:1788574553.077713:0:22614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8e0d2 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e8d expref: 17 pid: 22629 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574553.077763:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1788574553.077773:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d716dac-67f1-439f-bc22-0390f9279eab+17:2394:x1875455669087360:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574553.077787:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574553.077794:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8e0d2 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e8d expref: 17 pid: 22629 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.077834:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8e0d2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e8d expref: 17 pid: 22629 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.077858:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:3.0:1788574553.077864:0:22614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8e0ee lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e9b expref: 17 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.077875:0:22614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e188 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.077882:0:22614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e188 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.077890:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e188 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.077910:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574553.078158:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d716dac-67f1-439f-bc22-0390f9279eab+17:2394:x1875455669087360:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 385us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574553.078166:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00010000:00010000:2.0:1788574553.080609:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8e0d2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e8d expref: 16 pid: 22629 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574553.080633:0:22628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3d99880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22628:1875455681777664:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574553.080661:0:22628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e188 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.080671:0:22628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e188 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.080677:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e188 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.081063:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8e18f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.081079:0:22628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e157 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6eb7 expref: 16 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.081088:0:22628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8e18f lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.081124:0:22628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e157 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6eb7 expref: 16 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.081155:0:22628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e157 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6eb7 expref: 16 pid: 22628 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574553.081170:0:22628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22628:1875455681777792:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574553.081298:0:22628:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85f7abe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574553.084962:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574553.085050:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669087488 00000100:00100000:0.0:1788574553.085060:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669087488 00010000:00010000:0.0:1788574553.085100:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e157 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6eb7 expref: 17 pid: 22628 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574553.085138:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:0.0:1788574553.085156:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d716dac-67f1-439f-bc22-0390f9279eab+17:2393:x1875455669087488:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574553.085170:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574553.085205:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e157 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6eb7 expref: 17 pid: 22628 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.085220:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e157 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6eb7 expref: 17 pid: 22628 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.085243:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:0.0:1788574553.085249:0:22612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8e18f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.085258:0:22612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8e18f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.085277:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8e18f lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.085298:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574553.085350:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d716dac-67f1-439f-bc22-0390f9279eab+17:2393:x1875455669087488:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 196us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574553.085358:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00010000:00010000:3.0:1788574553.086641:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8e157 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6eb7 expref: 16 pid: 22628 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574553.086662:0:22628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22628:1875455681777792:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574553.086682:0:22628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8e18f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.086690:0:22628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8e18f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.086708:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8e18f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788574553.086857:0:22628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1788574553.086981:0:22628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1788574553.087021:0:22628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1788574553.087169:0:22628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22628:1875455681777920:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788574553.087279:0:22628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574553.087311:0:22628:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c376ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574553.087448:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681777920 00000100:00100000:0.0:1788574553.087456:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681777920 00000100:00100000:0.0:1788574553.087505:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788574553.087515:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c22f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22628:x1875455681777920:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788574553.087613:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c22f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22628:x1875455681777920:12345-0@lo:1000:mdt00_001.0 Request processed in 99us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574553.087634:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788574553.087721:0:22628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22628:1875455681777920:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788574553.087889:0:22628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1788574553.087931:0:22628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3d9bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22628:1875455681778048:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788574553.087959:0:22628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574553.087983:0:22628:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85f6f2d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574553.088303:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681778048 00000100:00100000:3.0:1788574553.088309:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681778048 00000100:00100000:3.0:1788574553.088337:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788574553.088344:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22628:x1875455681778048:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788574553.088456:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22628:x1875455681778048:12345-0@lo:1000:mdt00_001.0 Request processed in 112us (496us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1788574553.088463:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788574553.088653:0:22628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3d9bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22628:1875455681778048:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788574553.088684:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8e18f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.088693:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8e18f lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.088700:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8e18f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.088706:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217e400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574553.088718:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8e18f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.088726:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8e18f lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.088742:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:1.0:1788574553.088746:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574553.088763:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8e18f lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.088771:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8e18f lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.088806:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8e0e7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.088812:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8e0e7 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.088823:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8e0e7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.088828:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac8600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574553.088831:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8e0e7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.088837:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8e0e7 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.088844:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:1.0:1788574553.088847:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574553.088858:0:22628:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8e0ee lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e9b expref: 19 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.088870:0:22628:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8e0ee lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e9b expref: 19 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.088879:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8e0ee lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e9b expref: 19 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574553.088928:0:22628:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e200/0x5bf8706fdac8e0ee lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6e9b expref: 19 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574553.088940:0:22628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3d9a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22628:1875455681778176:192.168.204.51@tcp:105: 00000100:00100000:1.0:1788574553.089047:0:22628:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85f6f2de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574553.092468:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574553.092528:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669087616 00000100:00100000:3.0:1788574553.092539:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669087616 00000100:00100000:3.0:1788574553.092604:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:3.0:1788574553.092617:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b2f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d716dac-67f1-439f-bc22-0390f9279eab+20:18811:x1875455669087616:12345-192.168.204.51@tcp:49:dd.0 00000100:00100000:3.0:1788574553.092778:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b2f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d716dac-67f1-439f-bc22-0390f9279eab+20:18811:x1875455669087616:12345-192.168.204.51@tcp:49:dd.0 Request processed in 164us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574553.092786:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:2.0:1788574553.093817:0:22628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3d9a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22628:1875455681778176:192.168.204.51@tcp:105: 00010000:00010000:2.0:1788574553.093844:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8e0e7 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.093855:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac8600/0x5bf8706fdac8e0e7 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.093912:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e196 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.093928:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e196 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.093940:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e196 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.093950:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e196 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.093957:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e196 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.093964:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e196 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.093970:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574553.093974:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e196 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.093981:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e196 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.093991:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:0.0:1788574553.093994:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574553.093998:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e196 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.094004:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8e196 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.094030:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e188 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.094975:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e188 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.094985:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e188 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.094991:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574553.094993:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e188 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.095000:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e188 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.095011:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:0.0:1788574553.095014:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788574553.095018:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e188 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.095024:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8e188 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574553.095230:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d716dac-67f1-439f-bc22-0390f9279eab+19:18812:x1875455669087232:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 23873us (24395us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1788574553.095241:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00000020:00080000:0.0:1788574553.095247:0:22628:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788574553.095486:0:22662:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788574553.095491:0:22662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788574553.095506:0:22662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788574553.095513:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788574553.097403:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574553.100125:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574553.100228:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669088000 00000100:00100000:3.0:1788574553.100239:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669088000 00000100:00100000:3.0:1788574553.100302:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1788574553.100313:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d716dac-67f1-439f-bc22-0390f9279eab+19:18812:x1875455669088000:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788574553.100625:0:22630:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788574553.100660:0:22630:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1788574553.100697:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e19d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.100713:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e19d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.100725:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e19d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.100734:0:22630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e19d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.100740:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e19d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.100747:0:22630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e19d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.100776:0:22630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574553.100803:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574553.100812:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e19d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.100820:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac9800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574553.100824:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e19d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.100833:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e19d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574553.100843:0:23650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669087744 00000100:00100000:0.0:1788574553.100849:0:23650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669087744 00000100:00100000:0.0:1788574553.100894:0:23650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:0.0:1788574553.100901:0:23650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d716dac-67f1-439f-bc22-0390f9279eab+22:18811:x1875455669087744:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:0.0:1788574553.100913:0:23650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574553.100927:0:23650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8e1a4 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ed3 expref: -99 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.100968:0:23650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8e1ab lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.100979:0:23650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8e1ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.100989:0:23650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8e1ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.101091:0:23650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8e1a4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ed3 expref: 24 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.101109:0:23650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8e1ab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ed3 expref: 23 pid: 23650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574553.101118:0:23650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c85d07b8a00) 00010000:00010000:0.0:1788574553.101120:0:23650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788574553.101122:0:22615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:2.0:1788574553.101124:0:22615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788574553.101124:0:23650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7200, rc 0) 00010000:00010000:2.0:1788574553.101128:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e19d lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.101143:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85f7ac9800/0x5bf8706fdac8e19d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.101155:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574553.101156:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574553.101158:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574553.101184:0:23650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d716dac-67f1-439f-bc22-0390f9279eab+23:18811:x1875455669087744:12345-192.168.204.51@tcp:101:dd.0 Request processed in 283us (3790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574553.101214:0:23650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:3.0:1788574553.101957:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d716dac-67f1-439f-bc22-0390f9279eab+22:18812:x1875455669088000:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 1642us (1839us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1788574553.101968:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000020:00080000:3.0:1788574553.101973:0:22630:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788574553.164737:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574553.164788:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574553.164827:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574553.164862:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574553.164883:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574553.164900:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574553.164924:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574553.164970:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669088768 00000100:00100000:1.0:1788574553.164981:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669088768 00000100:00100000:1.0:1788574553.165039:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669088384 00000100:00100000:1.0:1788574553.165043:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669088384 00000100:00100000:0.0:1788574553.165055:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669088256 00000100:00100000:1.0:1788574553.165060:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669088896 00000100:00100000:0.0:1788574553.165062:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669088256 00000100:00100000:1.0:1788574553.165066:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669088896 00000100:00100000:1.0:1788574553.165087:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:1.0:1788574553.165099:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+5:2394:x1875455669088768:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574553.165105:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669088512 00000100:00100000:0.0:1788574553.165110:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669088512 00000100:00100000:0.0:1788574553.165132:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669088640 00000100:00100000:0.0:1788574553.165135:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669088640 00000100:00100000:0.0:1788574553.165151:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:0.0:1788574553.165158:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d716dac-67f1-439f-bc22-0390f9279eab+5:2394:x1875455669088256:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574553.165176:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+5:2394:x1875455669088768:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 78us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574553.165184:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:1.0:1788574553.165234:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:1.0:1788574553.165241:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d716dac-67f1-439f-bc22-0390f9279eab+5:2394:x1875455669088384:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574553.165276:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d716dac-67f1-439f-bc22-0390f9279eab+5:2394:x1875455669088384:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 25us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574553.165283:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:1.0:1788574553.165295:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:1.0:1788574553.165300:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+5:2394:x1875455669088896:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574553.165325:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+5:2394:x1875455669088896:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 24us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574553.165332:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00080000:1.0:1788574553.165352:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574553.165352:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d716dac-67f1-439f-bc22-0390f9279eab+5:2394:x1875455669088256:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 192us (624us total) trans 0 rc 0/0 00000100:00080000:1.0:1788574553.165357:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574553.165362:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574553.165366:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574553.165366:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:0.0:1788574553.165386:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:1.0:1788574553.165507:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:1.0:1788574553.165516:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+5:2394:x1875455669088640:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574553.165554:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+5:2394:x1875455669088640:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 40us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574553.165555:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:2394:x1875455669088512:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574553.165568:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:0.0:1788574553.165601:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9b2dd6-a8f1-4669-acb6-2a6fb947733d+6:2394:x1875455669088512:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 206us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574553.165612:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:2.0:1788574553.165680:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669088128 00000100:00100000:2.0:1788574553.165685:0:22619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669088128 00000100:00100000:2.0:1788574553.165727:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:2.0:1788574553.165735:0:22619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:2394:x1875455669088128:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574553.165770:0:22619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:736c8a31-7c1d-4ce2-8dd1-ba89b83d2fdc+13:2394:x1875455669088128:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 37us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574553.165777:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:1.0:1788574553.235529:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681778304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574553.235620:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574553.235677:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574553.235683:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681778432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574553.235704:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574553.236335:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681778304 00000100:00100000:0.0:1788574553.236347:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681778304 00000100:00100000:0.0:1788574553.236401:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681778432 00000100:00100000:0.0:1788574553.236404:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681778432 00000100:00100000:0.0:1788574553.236423:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788574553.236431:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681778304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574553.236467:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788574553.236540:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681778304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574553.236548:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788574553.236565:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788574553.236571:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681778432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574553.236588:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788574553.236603:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681778304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574553.237636:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681778432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1058us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574553.237647:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788574553.238759:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681778432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574553.372386:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574553.372538:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574553.374998:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669089152 00000100:00100000:2.0:1788574553.375015:0:24141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669089152 00000100:00100000:2.0:1788574553.375094:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669089024 00000100:00100000:2.0:1788574553.375097:0:24141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669089024 00000100:00100000:2.0:1788574553.375122:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1788574553.375131:0:24141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1d716dac-67f1-439f-bc22-0390f9279eab+8:2396:x1875455669089152:12345-192.168.204.51@tcp:4:dd.0 00002000:00010000:2.0:1788574553.375181:0:24141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9b7b58, atime: 0x6a9b7b57, ctime: 0x6a9b7b58, blocks: 0x0 00010000:00010000:2.0:1788574553.375210:0:24141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8e1b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.375227:0:24141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=693s v=(0 0) 00010000:00010000:2.0:1788574553.375244:0:24141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574553.375251:0:24141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8e1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.375278:0:24141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8e1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788574553.462668:0:24132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:1.0:1788574553.462685:0:24132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:3.0:1788574553.463257:0:24141:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:3.0:1788574553.463273:0:24141:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:3.0:1788574553.463292:0:24141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8e1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.463324:0:24141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8e1b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.463333:0:24141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8e1b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.463339:0:24141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217f200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574553.463343:0:24141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8e1b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.463351:0:24141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8e1b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.463370:0:24141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8e1b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.463377:0:24141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef766547/0x5bf8706fdac8e1b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574553.463492:0:24141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1d716dac-67f1-439f-bc22-0390f9279eab+6:2396:x1875455669089152:12345-192.168.204.51@tcp:4:dd.0 Request processed in 88357us (91113us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788574553.463502:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1788574553.463532:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:3.0:1788574553.463543:0:24141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1d716dac-67f1-439f-bc22-0390f9279eab+5:2395:x1875455669089024:12345-192.168.204.51@tcp:4:dd.0 00002000:00010000:3.0:1788574553.463585:0:24141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 7654321, mtime: 0x6a9b7b58, atime: 0x6a9b7b57, ctime: 0x6a9b7b58, blocks: 0x1a68 00010000:00010000:3.0:1788574553.463608:0:24141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8e1b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.463669:0:24141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=693s v=(0 0) 00010000:00010000:3.0:1788574553.463673:0:24141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574553.463679:0:24141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8e1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574553.463691:0:24141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8e1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788574553.560307:0:24132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:2.0:1788574553.561183:0:24141:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1788574553.561234:0:24141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8e1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.561248:0:24141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8e1b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.561269:0:24141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8e1b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.561277:0:24141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85f7ac8800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574553.561282:0:24141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8e1b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.561292:0:24141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8e1b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.561311:0:24141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8e1b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574553.561327:0:24141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dd477b8/0x5bf8706fdac8e1b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574553.562097:0:24141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1d716dac-67f1-439f-bc22-0390f9279eab+5:2395:x1875455669089024:12345-192.168.204.51@tcp:4:dd.0 Request processed in 98548us (189551us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788574553.562110:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00010000:00010000:0.0:1788574553.619735:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574553.753446:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681778560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574553.753525:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574553.753759:0:24140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681778560 00000100:00100000:0.0:1788574553.753767:0:24140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681778560 00000100:00100000:0.0:1788574553.753822:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788574553.753832:0:24140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681778560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574553.753854:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:0.0:1788574553.753908:0:24140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681778560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574553.753928:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788574553.753971:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:0.0:1788574553.753977:0:3619:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c85c2f45180, transno 12884901892 00000004:00080000:0.0:1788574553.753986:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:0.0:1788574553.754016:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681778560:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788574554.646050:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574555.158445:0:22662:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788574555.158455:0:22662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788574555.158476:0:22662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788574555.158484:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788574555.283531:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681778688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574555.283611:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574555.284318:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681778816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574555.284353:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574555.284383:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fb9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681779328:0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.284406:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574555.284422:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681779840:0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.284445:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574555.284460:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681780352:0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.284480:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574555.284500:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788574555.284506:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a90d265-af03-4b80-95da-0de9cffed3f2:3617:1875455681778944:0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.284534:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574555.284567:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681779456:0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.284589:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574555.284605:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681779968:0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.284625:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574555.284657:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681778944 00000100:00100000:2.0:1788574555.284664:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681778944 00000100:00100000:2.0:1788574555.284725:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788574555.284734:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+24:3617:x1875455681778944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.284780:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a90d265-af03-4b80-95da-0de9cffed3f2+24:3617:x1875455681778944:12345-0@lo:400:kworker.0 Request processed in 48us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574555.284788:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788574555.284820:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681779840 00000100:00100000:2.0:1788574555.284824:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681779840 00000100:00100000:2.0:1788574555.284844:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681780352 00000100:00100000:2.0:1788574555.284847:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681780352 00000100:00100000:2.0:1788574555.284864:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681779456 00000100:00100000:2.0:1788574555.284866:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681779456 00000100:00100000:3.0:1788574555.284972:0:24140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681778688 00000100:00100000:3.0:1788574555.284977:0:24140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681778688 00000100:00100000:3.0:1788574555.284999:0:24140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681778816 00000100:00100000:3.0:1788574555.285001:0:24140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681778816 00000100:00100000:3.0:1788574555.285013:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788574555.285018:0:24140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681778688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788574555.285040:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788574555.285072:0:24140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681778688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574555.285077:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788574555.285087:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574555.285092:0:24140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681778816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574555.285099:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788574555.285116:0:24140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681778816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 25us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574555.285121:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788574555.285169:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681779968 00000100:00100000:2.0:1788574555.285173:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681779968 00000100:00100000:2.0:1788574555.285235:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788574555.285242:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681779840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.285274:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681779840:12345-0@lo:400:kworker.0 Request processed in 33us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574555.285280:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788574555.285292:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788574555.285297:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681780352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.285322:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681780352:12345-0@lo:400:kworker.0 Request processed in 25us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574555.285327:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788574555.285338:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788574555.285349:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681779456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.285375:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681779456:12345-0@lo:400:kworker.0 Request processed in 31us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574555.285390:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788574555.285402:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788574555.285408:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681779968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574555.285418:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681779328 00000100:00100000:1.0:1788574555.285422:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681779328 00000100:00100000:2.0:1788574555.285435:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681779968:12345-0@lo:400:kworker.0 Request processed in 28us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574555.285441:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788574555.285447:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788574555.285453:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681779328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.285468:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681779200:0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.285494:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574555.285498:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681779328:12345-0@lo:400:kworker.0 Request processed in 46us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574555.285504:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788574555.285512:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681779712:0@lo:400:kworker.0 00000100:00100000:1.0:1788574555.285521:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681779200 00000100:00100000:1.0:1788574555.285524:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681779200 00000100:00100000:2.0:1788574555.285531:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574555.285593:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681780224:0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.285629:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574555.285670:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681778688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574555.285687:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788574555.285692:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681779072:0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.285716:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574555.285736:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681779584:0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.285755:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574555.285773:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681780096:0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.285805:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574555.291010:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681780224 00000100:00100000:0.0:1788574555.291026:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681780224 00000100:00100000:0.0:1788574555.291094:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681780096 00000100:00100000:0.0:1788574555.291098:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681780096 00000100:00100000:0.0:1788574555.291121:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788574555.291131:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681780224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574555.291262:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681780224:12345-0@lo:400:kworker.0 Request processed in 132us (5631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574555.291270:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788574555.291287:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788574555.291294:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681780096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574555.291341:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681780096:12345-0@lo:400:kworker.0 Request processed in 48us (5535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574555.291348:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788574555.293631:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681779712 00000100:00100000:2.0:1788574555.293646:0:24138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681779712 00000100:00100000:2.0:1788574555.293697:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788574555.293706:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681779200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.293818:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681779200:12345-0@lo:400:kworker.0 Request processed in 113us (8322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574555.293825:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788574555.293843:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788574555.293850:0:24138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681779712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.293879:0:24138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681779712:12345-0@lo:400:kworker.0 Request processed in 30us (8346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574555.293885:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788574555.293913:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681779072 00000100:00100000:2.0:1788574555.293918:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681779072 00000100:00080000:0.0:1788574555.294621:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574555.294628:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574555.294630:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681779584 00000100:00080000:0.0:1788574555.294631:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574555.294634:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574555.294636:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681779584 00000100:00100000:3.0:1788574555.294661:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788574555.294669:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681779072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.294932:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788574555.294941:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681779584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574555.294987:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681779072:12345-0@lo:400:kworker.0 Request processed in 318us (9268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574555.294995:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788574555.294997:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681779584:12345-0@lo:400:kworker.0 Request processed in 58us (9241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574555.295002:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788574555.295044:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a90d265-af03-4b80-95da-0de9cffed3f2:3617:1875455681778944:0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.295061:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681779456:0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.295072:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681779968:0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.295092:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681778816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574555.295103:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fb9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681779328:0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.295114:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681779840:0@lo:400:kworker.0 00010000:00080000:2.0:1788574555.295128:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c335f480 x1875455681780352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574555.295405:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681779072:0@lo:400:kworker.0 00000100:00100000:0.0:1788574555.295417:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681779584:0@lo:400:kworker.0 00010000:00080000:0.0:1788574555.295430:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c335ea00 x1875455681780096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574555.295439:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681780096:0@lo:400:kworker.0 00000100:00100000:0.0:1788574555.295452:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681779200:0@lo:400:kworker.0 00000100:00100000:0.0:1788574555.295463:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681779712:0@lo:400:kworker.0 00000100:00100000:0.0:1788574555.295473:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681780224:0@lo:400:kworker.0 00000100:00100000:2.0:1788574555.295927:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681780352:0@lo:400:kworker.0 00000001:02000400:0.0:1788574555.516809:0:25713:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788574555.668361:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574556.692446:0:23782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14158 lines, 14158 kept, 0 dropped, 0 bad.